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PHEFACE 






Th© rapid expansion of research and developnen'fc in vocational 
and technical education has placed Increased demands on the vocational 
education research community* The availability of Federal funds for 
research has been parall'iled in many instances by increased funding 
from state and local sovtrces# Renewed vigor and interest in research 
have penaeated all levels of vocational and technical education* 

Viwlng the vocational education research effort in an org/ani- 
zational frame of reference, we recognize the critical role assigned 
to the State Research Coordinating Units* There are inherent in 
these evolving structures opportunities for effective leadership, 
coordination, and stimulation of research and development activities 
throughout the several states* The major purpose of this seminar 
was to assist personnel in these coordinating units and other edu- 
cational leaders in planning and conducting comprehensive state 
programs of research and development# 

V7e want to express our appreciation to the resource personnel 
who effectively contributed to the development of this purpose. 
Recognition is also due Dr# C# W. Hill, Professor of Agricultural 
Education at Coitiell University, who served as coordinator of the 
national research seminar series, for his interest and assistance 
in this seminar# We would also like to acknowledge the work of the 
members of the Seminar Planning Committee and Dr# Virgil E# 
Christensen who served as seminar coordinator and who prepared 
this report# 

We trust that this publication will prove to be of con- 
tinuing assistance to the participants and to others who were not 
able to attend# 

Robert E# Taylor 
Director 
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INTI^DIXJCTION 



The five-day semljiar reported herein proved to be one of the 
”stonnio9t” five days in the history of research# Blizzard con- 
ditions end abnonnaZly heavy snowfalls beset the sessions from 
hours before opening until hours after the last departing partici- 
pant *s plane finally received clearance for take-off# 

While snowdrifts on the outside piled high a non-nomal 
skewed distribution sixty of the sixty-twro Invited participants 
'•plowed” their way through the most formidable problems of 
organizing and conducting effective VocationaJL Education Research 
Coordinating Units* To the Seminar participants, consultants and 
speakers; who made such noble efforts to keep the planned program 
on schedule, go our sincereiit thanks* 

The contents of this report are in several instances tran- 
scriptions fi?om •tepe recordings, made during the Seminar and as such 
are subject to the inevitable errors* 

I appreciate the Seminar consultant' willingness to share 
their materials and trust that they, along ^rith the mader, will 
understand and overlook any misquotes appearing herein* 



V. E. C. 
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BY com^mrss 



THE PESEARCH AND DEVBIDPMENT CONCEPT - 
VJHAT 2S THERE TO BE DONE AND WHO CAN DO IT BEST? 

R. E* Jongeward 



* Historically in America there has been the ciy — “There must 
be ^ better way! ” Someone always builds better mousetraps. It is 
an American expactaneys especially among business and Industrial 
concemsr 

Until recently there have been two notable receptions— the Church 
and the School. Recent religious stirrings reveal movement and re- 
examination of historic and traditional boliefs* For the first time 
in 800-900 years a Catholics may be eating meat cn Fridays ^ It is 
even conceivable that Southern Baptists may soon drink in front of 
one another. Ecumenicalism is creating new patterns of worship and 
causing religious st 2 *angers to examine the likenesses and differences 
of one another *s Hh, The old-time strains of ’’Give me that old- 

time religion that was good enough for father” are fading into the 
yester-years. 

Grandpa *s little old red schoolhouse with its oxcart methods and 
single purpose curriculum is losing the nostalgia it once held. There 
is new life, new hope, new dreams of a modem, second-to-none edu- 
cational system for everyone— including the poor and those whose color 
is less than white. Change, a word infrequently used and with little 
meaning among the now grey-headed educators, has suddenly burst forth 
with great force, almost engulfing student and teacher alike. The 
end is not yet in sight when the pace of change may be slowed. 
fact, increased ed’icational funds, a booming economy and a rapidly 
changing technology all point tc an even greater terpe in the future. 
With over 50^ of our population under 25 years of age, the restlessness 
and impatience of youth are easily seen in our schools, on college 
caiiipuses, and on our streets. 

It. is little wonder, therefore, that we find ourselves somei-That 
bewildered and perplexed by the events of the day. We are awakening 
to the fact that we are living in one of Margaret Mead’s "other 
worlds.” Some are finding that they are being passed by, others and 
struggling to keep up with the vast conplexities of our modem day. 
Hopefully many will successfully throw their arms about the problems 
of the day even though it is difficult to find mere hand holds. 



Director of Research, Washington State Office of Public 
Instruction, Olympia, Washington, 
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It seems entirely appropriate today, therefore, that wo should 
consider getting recent research into action by examining what it is 
that needs doing, who should do it and how shall it be acco^lished. 
This paper has presented an opportunity for me to express seme 
personal opinions and observations about these questions, I have 
welcomed -^is since they represent my internal struggles over the 
past four years as Di:K>'ctor of Educational Besearch in the State of 
Washington, As a result, you may find this discourse less than 
academic and not carefully documented from the research literature 
but rather (hopefully) a logical analysis of a series of alternatives 
that seems to lead to an inevitable conclusion, 

Basic to my thesis is the premise that somehow, somewhere, 
sometime educational research should affect the student and the 
quality of the program offered. Granted, this is a narrow definition 
of research and not acceptable to everyone. 

Perhaps crudely indeed, and at the risk of omitting iiaportant 
approaches to getting i?esesrch into action, I*d like to examine four 
or five approaches to this basic idea that ”there is a better way” and 
what effect they have upon the student and the teacher, 

(1 ) This approach is one with which we are all familiar. It 
is the Higher«»Education«Oriented approach to Educational 
Hesearch and Development in which the College and Uni'- 
versity expei-ts ”do the research and tell tlie answers.” 

(No quarrel with the need for tJhiversity/College Research 
^t recall the basic premise.) The thought here is that 
”experts tell, and everyone listens," or that "telling is 
teaching," or "listening is learning," Yes, it*s true 
some people do listen and learn but widespread effect 

in practi.ee is usually missing - why else the 25-50 year 
lag between discoveiy and application? Obscure and 
technical language usage has also acted as a detevrent 
to effective communication and general acceptance. Let’s 
admit too , that familiarity with research has not been a 
strong emphasis in teacher education, 

(2) A second approach may be thought of as the prescribed- 
currioulum-approach. Rigid state department r»iles and 
regulations may frequently represent this pattern. No 
changes can be made in methods, materials, or techniques 
unless they have been "approved" by the great white father 
in the state office. Students receive a sterile diet of 
packaged and safe knowledges. Teachers are rewarded for 
conforming to set patterns and standardized contents. 

This approach, too, emphasizes the listen-and»*leam, 
telllng-is -teaching concept. Changes are infrequent, 
resisted, and suspected if proposed. The boast can be 
made of such schools and situations, *K)ur schools are just 
as good as they used to be"— in fact, they are exactly 
the same as they were 50 years ago I 
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( 3 ) Tho piodaot^r-gadget^rlented-approach to edaeational 
chtn^ is A recoRt phenoMnon that has sprang up idth 
ths sd*ant c? ths "hardbniro sslossan* and ths "^O-ssnt 
NDEA doUsr. * Hero, the rigidity of the State Depart- 
mmt approach is aissing— so is the research from the 
College and Uhiversityl There are also insidious 
eleiients at woric here too. Keeping up the Snob 
Hill_Sobool Distriet provides surf iclent incentive 
to order thousands of dollars of eqaipment— that was 
originally produced for industry and only slightly 
adapted for educational purposes.— that is touted to 
launoh a new era in educational practice hy its 
flashy advertisements and smooth sales personnel. 

Speed is %e watchword in order to use the ”cheap 
money'’ &^t I 9 available itow* and to be the first in 
the a^a to exploit a new breakthrough! Program 
objectives and planned evaluations are nonexistent 
and vezy soon thereafter dust is collecting on the 
equipment in the school storeroom or is discarded 
by tochers and administrators because maintenance 
costs were too high or. the students absconded with 
vital components, rendering the equipment useless. 

The profit motive, cheap money and the chance 
for quick reputations all combine to provide for 
rather widespread and quick spi«ad of the innovation 
or change that acconqpanied the *View hardware. ** Little 
or no assessment of the effect upon the student was 
made, frequently the change was short-lived, and 
teachers felt gvdlty and somewhat "burned” for having 
been "taken in" by the giiaaick'^j; of the innovation. 

Most of then vow not to change so easily next tine. 
Well-planned innovations will have a difficult time 
obtaining a favorable hoaxing in such situations. 

W A fourth approach to getting research into practice 
may be identified as the "dissenination-of-i'eseareh- 
informatlon” idea. This is the telief that if 
all that good, solid research leit untouched on 
College and Dhiversity shelves could only bo gottssi 
to the consuner—the teacher— the probl«a of lag or 
gap between research and practice would be solved. 

The pxoblems with this plan are manifold. 

Methods of infoznatlon retrieval are found to be very 
expensive, cumbersome, and not very efficient. Some- 
how, teachers don’t read the valuable raseareh journals, 
research reports, br3.efs and summaries that are prepared. 
If they do, very soon t arguments among staff 

members cn just "what does Ts^esearch say*^ on a given 
subject. They often oonoludo (not <mitirely justifiably 
nor unjustifiably) tiiat wo can prove any point of view 
with research— all we have to do is look long enough 
to find support for your own viewpoint. 




When this discovery is made the teachor is en- 
couraged to think that her own teaching stacks up with 
the best methods known to research? therefore, he is 
perfectly justified to continue, unchanged. As a 
result, the teacher becomes iE 5 )eivious to the changes 
that a» happening around her. 

(5) A fairly recent and new-to -education approach to im- 
proved educational method is now in 6?:istenoe. It's 
the effioiancy angle. Cost-benefit analysis, used 
successfully in the military and in industry offers 
justification to some school boards and administrators 
to make vast changes in organizational structures, 
personnel utilization ard instructional methods to 
effect greater economies in the school program. Un- 
fortunately again for st^idents, and for the qualitjr 
of programs offered them, these techniques while 
they worked well when applied to things do not pro(5luce 
the same results when used on people (students)* 

These methods have not l^een sufficiently tested or 
adapted to make them effective instruments in the 
hands of school personnel. There can bo little doubt 
as to the need for careful cost accounting practices 
being adopted T:y education, but these must be care- 
fully planned and tested before they are used. 

Now that I have disposed one-by-one of many of the existing 
(there are more— and the ones mentioned may exist in various combina- 
tions) educational practices for instituting much needed changes and 
for providing improved program offerings, you xaay rightly ask— so how 
does he propose to do it? 

answer may surprise you ... Honestly, I don't really know 
nyselfl I do have some clues, however, that appear to me to offer 
some promise. Let me suggest them. 

Shall we be as personal as we can? Li general, ho\? do we learn? 
Do we modify our behavior (leaxn) more easily when we are favorably 
inclined (positive attitude) toward the task at hand? Do we modl^ 
our behavior more easily during or after we have been actively engaged 
in some activity or pursuit? 

The answers, of course, are obvious and we have agreed to them 
for years. Ny question at this point is “Do we practice what we 
believe?” I think not! When we mount programs for getting what is 
known into immediate practice this is particularly the case. 

Students frequently attend colleges and univei*sities where it is 
do-as-I-say-not-as-I-do, rather than being actively involved in the 
process of learning, therel:^ gaining understanding by exasple as well. 
These students graduate, become teachers and only a handful discover 
(and probably accidentally) how learning takes place and soon become 
good teachers. Then school administrators, researchers, college 



in-ser7ice professors repeat, th© errors of the past by devising all 
sorts of schemes to got those staid teachers to change their methods, 
techniques and/or materials, ^'Then they don’t, wo can’t understand 
whyl 



Active involvement is fundamental to the learning process (we 
learned in Ed. 101 )• Therefore, I must irrevocably draw the con- 
clusion that if teachers are going to accept changes, adopt the latest 
research knowledge, or mal:o basic changes and iaq)roveBi©nts in their 
programs then they must actively participate in the process 'Uiat will 
enable them to learn and understand them, to develop positive 
attitudes toward them and finally adopt them as part of themselves. 
This seems so very basic if we realize that curriculum changes in a 
classroom actually represent changes (modified behavior) in people. 



An R & D Example 

The story is told of Winston Churchill during the year 191^ when 
he visited France and saw the beginning of World War I with soldiers 
in trenches and the use of other land fortifications. He retumed to 
England iB5>.reGsed hy the fact that an improved military technique for 
fighting such a war could include a movable platform from which soldiers 
could fight. He took this idea to Army personnel and after much dis- 
cussion they rejected .it as not practical. Tenacious Churchill 
decided that the idea still had meidt and went to the Royal Navy and 
proposed they undertake research and development work that might lead 
to the development of this idea. They finally agreed and with limited 
funds begaii exploring the feasibility of d6'*^islng such a vehicle. 
History, of course, reveals the success of this early R & D effort 
in the deveiopm®it of what we knew today as the tank. 

It is interesting to note that much of the original development 
by Navy personnel is still visible today. For example, the nomenclatu-*e 
associated with the tank denotes nautical connotations in a remarkable 
way, i.e., the body of the tank is known as the hull; the protection 
on the exterior resembled the armor plate of battleships; th© tank 
weapons aro found in turrets®«=other parts include such things as super- 
structure, bow, hatch and con^artment. 

At approximately the same period th® Germans began thinking about 
developing a similar idea. Geman Army personnel conceived of their 
vehicle as a mobile fortress. As a result of this R & D effort the 
resultant tank became a very heavy armor-plated, extremely bulky 
vehicle, known as a tank, that had VBvy little maneuverAbility in the 



Shortly after these two developments, the Americans began ex- 
ploring the development of a combat vehicle eabodying ailitaiy 
characteristics of firepower, mobility and crew protection. In this 
case the R & D effort was contracted to the auto man'ofacturers. Auto 
engineers perceived this vehicle to be a light, eas5.1y maneuverable 
weapon similar to the automobile of the di^. contrast, therefore, 
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to the English and German versions of the tanki the Americans devised 
autos known as light tanks weighing only three tons and carrsring from 
one to three men. The S. version that resulted from this ex- 
perimental effort actually resembled an armored automobiloe 



This story le&ds me to conclude that the day of the classroom- 
teacher-researcher is at hand if we are to fully realize cur objec- 
tive* This person would actively engage In processes of inventing, 
designing, field testing, demonstrating and disseminating research 
within the confines of the classroom, the school, and the district. 
Planning for change or working in an atmosphere of planned change is 
essential for all of us in education* 

In conclusion, the questions raised earlier iri this paper must 
be answered as follows: 

(1 ) Involvement of classroom teachers in research and 
research activities appears to hold the best promise 
of long-term educational improvement for studoiits and 
programs* 

(2) \*?ho must do it? Thera something for everyone— the 
College and University 'researcher, the State Depart- 
m0it research office, and the classroom teacher* Above 
all, there must bo excellent communication established 
among all participants and a wholesome team effort 
mounted if real progress is to occur* 

(3) ^'Ihat needs to be done? Everything— the sky is the limit! 





’‘Reaction to llr, Jongeward’s Presentation” 



by Dr. Robert N. Worthington* 



le (CoMnenting on Ray Jong 0 ward.*s statement that the teachers 
in the local school systems should be involved in research) : 

”I agree with Mr. Jongeward*s remarks that the teacher is 
the key to our effort. The teacher of vocational education and 
any subject for that matter, will make or break the program. 
They must be involved. They (the teacher) are the ones who ask 
the right questions~they pvvovide the feedback as to whether 
or not we are doing what we should do, I agree that in action 
research, the teachers might be reluctant to accept iimovations 
that appear artificial and many people think suggestions for 
change are artificifil if they didn’t have anything to do with 
it— let’s try to get teachers involved. As Stephen Corey 
say«,"action research is research undertaken by educators in 
the field in order to iitprove their practices, ’ The NEA 
Association for Curriculum avelopment says that action 
research aiid the action research idea has so much to recommend 
it that we should strive for the time when a part of every 
teacher’s day will be set ^side for action research as part 
of his regular load,” 



II, (Commenting on the remasks of action versus basic research): 

"Really a primary goal of research should be the iii 5 )rove- 
ment of institutions. Outcomes of action research are based on 
behavioral changes that occur in the teachers; the researchers 
themselves ^d.11 change as a result of this. Practices do not 
change unless the teachers themselves change. Action research 
depends upon interaction between individuals and groups. This 
promotes free flowing of ideas, creating means first solving 
problems and good group dynamics. The teachers should become 
a part of the research team. This I think should be our major 
thrust in our educational effort in vocational education. 

There is no doubt that we need basic research to find or ■ 
seek truth, but we need, it seems to me, to put a major 
thrust forward in action research getting teachers and schcol 
people involved as part of the total team oo that the dis- 
semination and diffusion will be built into our research efforts. 



Assistant Commissioner of Education, State Department of Edu- 
cation, Vocational Division, Trenton, New Jersey, 





IMPROVING RESEARCH IN VOCATIONAL EDUCATION 






Alan B« Knox 






lo Background 

A* The puxpose of the session thi.s woming is to explore a way 
of thinking about the improvement of research related to vo- 
cational education t as one of the professional roles of the 
Semiiiar participants (referred to in this outline as RCU 
staff), 

B, The purpose of this outline is to suggest some background 
ideas about working relationships between RCU staff and 
researchers within their state, so that the Seminar session 
can bo devoted to a discussion of detailed strategies. 

C, A helpful starting point is with the RCU staff member himself. 

1, Although he may perform other important duties, it is 
assumed that one of his major responsibilities is im- 
proving the quantity and quality of research in his 
state, related to vocational education. (It is 
recognized that in another role the RCU staff may 
be the researcher, as with "in-houGo” research.) 

2e ”Iiiproving” assumes some existing research activity 
related to vocational education, that should be 
considered, 

3* The helping relationship between the RCU staff and 
the existing and potential research activity within 
the state 

a, is exceedingly complex 

b. varies from situation to situation 

0 , requires enpathy for the local situation and 
flexibility in working relationships 

^0 The role of "change agent” is proposed as a useful way 
of thinking about on© of the major roles of the RCU 
staff, because the literature describing the "change 
agent" suggests 

do a simplified basis for uzuderstanding the helping 
relai^onship 



Prc'fossor of Education, Teachers College, Columbia 
University, New York City, 
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b. ways to diagnose facilitators and barriers 
in the lofjal situation 

c« decision points in a long-range strategy by 
iiClJ staff 



:a. 



toeral characteristics of a model to better understand the social 
lSkage°^ researchers TTith which the RC0 staff yfould establish 



A. A model is a sin^lified system that contains the major 
coD^onents 4ind dynamics of the more complex social system 
that we are txying to better understand. 



B. 



C. 



D. 



The parts of the systems model are interrelated components 
ana not ^ 



apSe 



For purposes of the present outline, it is proposed that 
the general concept of the "system" be thought of as the 
specific example of the University department of vo- 
cation^ education* (Other systems that might have 
be^ selected for illustrative purposes include a local 
school system or a stat« government bureau. ) The "system’ 
researchers and their related staff, along 

informal organisational structure 
within which they operate. 

approach a description of a system model 
for understanaMg how vo improve «ie quantity and quality 
^ re£;eaTCh related to vocational education, is to begin 

with a list of typical activities of the RCU staff as 
change agent. 



1 . 



2 . 



d. 



e 



in the improvement of research related to vocational 
education, RCU staff engage in the identification of 
a. agencie'5 and ^mits that are conducting and could 

pTOfi^bly conduct research related to vocational 
education 

(objStives)^°'^^ research activity 

the fisting amount and type of research activity 
cruc^l gaps between the existing circumstances 
and the changed circumstances 

tte activities or resources that are needed to 
close the gaps 

combination of activities by the RCU staff 
that constitutes an optimal strategy 

*''® objectives 

of rosea^h related to vocational edur-.tion in your 

^ “ade primarily 

^ sen staff. (Other sources of objectives include i 

of individual researchers j urgent 
problens facing teachers and administrators In the 



o 
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field of vocational education; goals of institutions 
sponsoring research related to vocational education; 
guidelines of state and federal governmental \mits 
that administer programs related to vocational edu- 
cation; and policies of government research granting 
agencies and private philanthropic foundations,) 

% An understanding of activities ”ct” ”ds" and ”e" 
especially can be increased by conceptualizing 
current research activities related to vocational 
education in your state (or a university within it) 
as a social system* 

E* The proposed system model related to vocational education 
research has three broad aspects— input, output, and 
functioning of the system* Each of these three aspects 
will be described briefly below to indicate inter- 
irelaiionships and the input and output aspects will be 
described in greater detail* 

1, Output - The primary output that is of interest to 
us in the present context is RESEARCH FINDINGS, (A 
secondary concern may be that the research findings 
be in a form and be produced by a process that en- 
courages utilization. However, it is important not 
to define "output” too broadly, so as to include all 
research related actiy^Lty and ways to actively 
achieve adoption of findings, or "output” will include 
nruch of education,) 

2. Iriput - To achieve the output of research findings, 
three types of input are needed 

a„ competent researchers 
b» priority ideas 
Cft money to buy time 

3* Functioning of the sjrstem - There are many *f actors 
that contribute to the levels of productivity and 
satisfaction that characterize a social system, (e,g, , 
the flow of Important communication between persons 
vTithin the system that contributes to coordination; 
and the relative level of satisfaction and continued 
cooperation that results from the balance between 
what the individual contributes to the achievement 
of organizational objectives and the set of incentives 
and rewards that ho receives). However, this point 
will be dealt with in the presentation by Dr, Joos, 
and the remainder of this outline will concentrate 
on the relationship between the ECU staff as 
change agents in relation to the input variables. 



-1 





III. The major output from the system is finding * from excellent 
research. To increase the quantity of inaa ..,aate research 
would be of little benefit to snyone, Reseai-oh findings are 
defined as tested knowledge from which we' may generalize, 

(It is recognized that useful research related activity such 
as evaluation or utilization or preparation of researchers 
may precede, acoonq^any, or follow research.) The process 
of producing tested knowledge typically includes 

A, identification of a question or problem where present 
knowledge is inadequate, 

B, development of a tightly reasoned rationale that 
explicitly states how the researcher is conceptualizing 
the problem, based on previous experience, research, and 
theory, 

C, statement, at critical points in the rationale, of 
predictions of anticipated relationships, 

D, collection and analysis of empirical data that is most 
pertinent to test the tenability cf the predictions and 
is most representative of the situations to which the 
researcher would generalize, and 

E, presentation of precisely stated conclusions which, if 
the research is successful, constitute tested knowledge 
from which we may generalize. 

IV« Three major types of input are proposed 

A. The most crucial t^e of input appears to be an adequate 
supply of conqpetent researchers who are interested in 
topics related to vocational education, 

1. It is assumed that educational research is becoming 
increasingly coti^lex and to conduct it in a way that 
produces tested knowledge from which we may generaliso 
requires a competent researcher. To become a competen 
researcher requires substantial education and ex- 
perience related to research theory and methods, 

2« There are three basic ways in which to increase the 
present inadequate supply of competent researchers 
who are interested in topics related to vocational 
education 

a. encourage the competent researchers who are 
currently engaged in research related to vo- 
cational education to devote mors of their 
time to this area of activity 

b. encourage competent researchers who are not en- 
gaged in research related to vocational education 
to pursue questions in this area 




c« increftSG th© supply ot ©oc^eten't researchors 
who will, pursue questions in this area 

3. The cwicial question is what can the ECU otaff do 
to most effectively increase this input? (We will 
return to this question at the end of the outline 
as a springboard for discussion*) 

B. Priority Heas for Research* The process of research is 
seeking answers to researchalile questions, the under- 
standing of which will contribute to the solution of 
pressing probleias in the field of vocational education. 

1, Uses of priority ideas for research 

a* to contribute to the solution of the most urgent 
problems 

b. to initiate researcher interest and activity 
related to vocational education 
Cc to obtain other needed support for research 

2a So irees of priority 

a« points to urgency for the consumer of research, 
such as might be identified by the critical 
Incident technique 

b» theoretical attractiveness to the researcher, 
because the idea has potenti^* for innovation, 
specific application of broader concepts, and 
theory building 

C: The major function of money ss an input is to buy time 
of the researcher, related staff, the couputer, etc., 
that is needed to conduct research* 

1 • The typical way in which to obtain money to buy 
time is to prepare a sound research proposal* 

2. Two major ingredients in a sound research proposal 
are a priority idea and a competent researcher* 

3# The present availability of money to support re- 
search related to vocational education is greater 
than ever before, and may even exceed the availability 
of con^etent researcheirs and priority ideas* 

Questions related to the role of the RCU staff in encouraging 
mWf excellent research related to vocational education, 
tnat will obtain tested knowledge from which we may 
generalise* 

1* Is the concept of the change agent role of the RCU staff, 
as they work with present and potential vocational edu- 
cation researchers, an appropriate and useful one? 
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2. To vhat extent does the interrelatedness of our most 

pressing problems justify the tise of a system model? ^ 

3# Hew warranted is our assun^tion that the need for re- 
search related to vocational education far exceeds the 
su|^3y7 How about the deoand and ul^ization? 

4. How necessary to the iii 5 >rov 6 iiait of research related to 
vocational education is increasing the amount of time 
hy competent ^searchers that is devoted to topics 
in this area? 

5# If crucial f then how can we identify the actions by RCIJ 
staff that would most effectively increase 13iis time 
commitment? (Host promising alternatives*) 

6* What existing circumstances provide the major source 
of resistance to Increasing research time on vocational 
education topics? 

?• What existing circumstances most facilitate the im- 
provement of research in vocational education? 

8* What additional incentives can be added to the system? 

9* Which resisting factors can be most effectively minimised 
and which facilitating factors can be most effectively 
maximized RCH staff? 





STROCTURING THE RESEARCH E^fVIRONMT 



by Loyal ’T, Joos 



* 



I am quite aware that this seminar has to do with reseai'ch in 
vocational education, which some think is a subdivision of education; 
and in spite of that I choose to talk about stimulating educational 
research, because I think of all education as having a vocational 
aspect, and also because I believe that the processes which will 
encourage research in vocational education are generally applicable 
in the general educational context. Let us begin by stating that the 
research enterprise needs a lot of stinrilatlng throughout education. 

It may seem to you that we in vocational education are vastly behind 
the general research progress in other educational groups. If so, I 
mean to bring you to think otherwise, because I believe that most of 
what passes for good research in education suffers by reason of 
certain lacks in basic philosophy which are les^ troublesome to us 
in vocational work than they are to those whose field may be 
described as educational psychology; yet it is in psychology that 
the research reports are found which are often cited as models of 
good research. 

For my part, I think of educational research as some systematic 
procedure carried on for the general purpose of adding to our store of 
useful educational knowledge; and I define useful to mean that the use 
or possession of the knewiedge will improve the educational process in 
one or more of several ways. ^-le can think of inq>rovements to input, 
to process, to output, and to utilizaticn. Ideas related to quality, 
quantity, and efficiency are all part of the picture of improvement. 

I believe, for example, that if we we?.*e to apply the power of the 
modem con^juter to the problem of the logistics involved in the 
school lunch program, to the end that better meals were available 
at 75^ of current cost, that this would be a contribution to edu- 
cation and a valid use of a researchc^r*s time. On the other hand, 
proving that better hot lunches increased learning rate I would 
regard as interesting but of considerably less ia^jortanceo 

I am to discuss with you some ways in which research may be 
stimulated; and I am going to avoid almost entirely the kind of re- 
search which is conducted in, for, or by colleges and universities, 

I shall be talking in teiros of that research often labeled as "'action 
research, " appairently because it is done by some one who is active 



3 ^ 

Director of Systematic Studies, Oakland Schools, 
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in education such as a teacher, supervisor, or school principal; 
rather than by soneon© who used to be active and is now renoved to 
some (presumably) higher level. Kor© about this later. 

It will bo seen that the efforts that might be made to provide 
a good ©search climate can be effective only if they are made by the 
right people; the researcher cannot provide his own climate for re- 
search, and he who does provide it is not likely to have been a 
researcher. So if you are not a researcher, but an administrator 
of some sort, then you are the one I want to talk to - but I want 
to warn you in advance that if you do this thing well, you will not 
be able to remain outside the process. You have to become involved. 
For example - 



Structure Basic to Reseayoh 



Structure has to do with the game and its rules. In this case 
the game is vocational education, and the rules say who shall bo 
allowed to participate, under what conditions, and for what goals, 

What are the goals of vocational education? How can you tell when 
you are winning? We have not done a very good job at stating the 
rules of vocational education, but wo have done a lot better than 
has been the case in, say, educational psychology. 

If your rules say that the object of the game is to train 
people for gainful employment, you have a rather specific measure of 
success. You could do some reliable studies to show how well you 
played the game. Unfortunately, such specific and narrow-gauge 
structure will tend to throttle research of such questions as ”Are 
the right people being trained?" "Is vocational training productive 
of general skills?" or some others you might think of. 

In building a structure for research in vocational education, 
wo must begin by re-thinking the whole purpose and philosoply of vo- 
cational education. Further, we must write all this thinking down 
so it can bo read and studied by the practitioner, so that the 
teacher in the classroom can see that what he is doing is not in- 
structing a boy merely how to drill a hole without breaking the bit, 
but educating him to m awareness of the total significance of that 
process. The reason is sls 5 )le; unless the practitioner is aware 
of the whole problem, he can do little useful thinking about better 
ways to attain the total goal. 

Of cou^e 3 TOU could atten^t to stimulate research just by saying 
to the practitioner, "I want you to study what you are doing and try 
to think of better ways to do it, 1*11 give you extra time, and even 
reward you with a promotion if your research report looks good, " I 
don*t think this will work, but even if it did, the result would be 
that you would soon have to choose between letting him take over 
3Tour job as a leader or tolling him that you have changed your mind, 
and he can stop thinking. 
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No, as a leader you are also the keeper of the rules. You make 
the philosophy of vocational education, and without a philosophy (or 
theory) research is ic^ossible. You begin with theory, develop one 
or more hypotheses fi>3m the theory, set up a systematic test of the 
hypotheses, and atteDi})t to reconcile the results with your philosophy. 
This is fundamental, and you must see that it is done. 



Provocation as a gtiimilus 

Now that you have done all this heavy thinking, your problem is 
to get some practitioners involved. You might try provoking them in 
the manner of Dr® Conant or of Admiral Rickover; except that research 
designed to prove someone wrong is rather sterile exercise, I would 
recommend, instead, a combination of skepticism and faith. Lot 
people know that you are skeptical of the present wa 3 TS of doing 
things, but that you have faith in their ability to do bettor. 

Please notice that if you have properly structured the rules, "doing 
better" will have been defined. The skepticism may stimulate some 
research into the question, "How badly have wo been doing?" and this 
will very soon, of itself . produce some obvious ways of improving. 

Some years ago, for example, a researcher was given the task of 
studying the vocational agriculture departments in Baltimore County, 
Maryland, The problem was simply stated: Should BaltiiHore County 

continue to offer vocational agriculture courses in Franklin and 
Hereford high schools? How Hereford was (and is) the oldest such 
department in the United States, Yet he discovered that it had never 
served the purpose for which it was established, for the reason that 
most prospective farmers dropped out of school befors the 10th grade, 
which was the earliest opportunity to enroll in vocational agri- 
culture, As a result of this research, a plan was finally (after 
40 years) set up whereby 9th grade boys could enroll. There are 
several lessons which could bo drawn from ray example, but I will 
mention only one, which is that it is not enough to draw up the rules; 
someone has to keep score. Of course, keeping score means more than 
filing state reports, I sometimes think that wo could learn a lot 
from the sport*s world, where wo find that a baseball manager has 
detailed statistics on every major league player, including the 
number of times he has swung at & low outside pitch, 

I know that when the clivaate is right for research, the 
practitioner who is uncomfortable with the job being done has an 
alternative. Ho doesn*t have to got out of teaching in order to be- 
come fulfilled; he can instead exporiement within a broad and per- 
missive structure. Ho can be allowed to think and to innovate; indeed 
he can and should bo aided and abetted. First, however, you have to 
stimulate somo action, and a good way is to provoke people by sotting 
the dogs on as many sacred cows as possible. 





18 



New Categpyies fo r Old 

There is a useful habit of thought which operates by labels 
and categorief;* For example t we call education vocational when it 
intends to txain people for es??lojmient, and when wo talk about 
various methods or plans of operating, those tend to bo labeled with 
the names of people or places, like ”th9 New Jersey plan,” or 
”Rogerian counseling,” and the like. As useful and convenient as 
this may be for talking about what has been, it is a straight- jacket 
when it comes tc research and innovation, because fresh ideas and 
methods tend to be lucked into old categories arid forgotten. It is 
too easy to give a new thought only cursory consideration, just 
enough to say, ”0h, that's the same thing that Smith tried in New 
York in the twenties. Didn't woric out.” 

Unfortunately, educational literature is fuH of these dead 
categories; they are in fact embalmed and preserved in toctbooks used 
to teach our teachers about education. It almost seems that some 
professors care less about the utility of a thing than about the 
students being able to identify the label of it. Suppose, for 
exas^le, we were to talk about a linguistic method of teaching 
reading. Nineteen out of twenty 2 *aading experts will say, ”Ah, 
Bloomfield! ” and quit listening. 

Now, if the researcher in education is to have an adequate 
”label structure” in his thinking, he must have a 1st of extra 
categories handy under any general heading so that he is quite pre- 
pared to put a different label on each fresh "linguistic method, ” 
or each fresh idea in vocational education. It may turn out that 
the latest thing to come to attention is the same old idea that has 
carried two other labels before, but you can't afford to vsay so 
until you are sure, and perhaps not even then. Nothing so dis- 
courages the neophyte in research as to be told ”that's been tried 
before, ” and nothing is so infuriating as to hear this from someone 
who hasn't really listened long enough to know what is being said. 



A Time for Research 

The Bible tells us that there is a time to live and a time to 
die, along with a time for evexything else; research is a notable 
exception. I can tell you from experience that it is always too late 
to begin a research project. Perhaps the tremble is with the notion 
that research is done in projects, while education just keeps on 
going endlessly. ]h the case of research conducted practitioners, 
the first obligation of the teacher is to conduct the prescidbed pro- 
gram. If nothing is introduced to break the rhythm, the daily, 
weekly, and yearly round will continue without much change. 

At present, the research efforts of practitioners usually 
result from the necessity of fulfilling the requirements for ad- 
vanced degrees. Such research is usually a one-shot affair; with 
the requirement fulfilled, the research is terminated, never to be 





rosuned* Si cssos this is ft good thingf bso&uso & first ti^ 
ftt research is likely to be fairly treated if buried with as little 
fanfare as possible* In those instances where liie degree-seeker 
does more than the minimum of researoht the usual thing is that h® 
has loft the active field and has been drawn into the halls of higher 
leamingt and so has passed out of ray consideration of active re- 
searchers* 

The cooperative research program of the U*S.0*E*, and more 
recently certain other acts of goveinraont,have provided in the first 
case the encouragement and opportunity to do research, which tended 
to be initiated by college and university personnel; and in %e later 
cases a kind of mandate to research and/or evaluate which is un« 
doubtedly tlie reason that we are here today* The recent expansions 
of research efforts have revealed an interesting thing, and that is 
the very poor fit between traditional research teclinology and l&e 
tasks which face the researcher in practical educational fields* 

Small sample studies, based on the normal probability model, are 
woefully inadequate for our needs today; I shall have more to say on 
this another time* 



These stimuli to research are, I presume, introducing ’^breaks 
in the rhythm,” which I mentioned earlier* Research must be con- 
ducted, if not because the federal aid rules require it, certainly 
because ■tiie shifting educational situation requires valid informa- 
tion of a very practical kind* Some of us ai?e learning xdght now 
how to design and conduct s'bjdies undreamed of five years ago, I 
have personally conducted an analysis on survey data conqposed of 
responses from more than «^5#000 people, and summarized those data 
in treble form in a matter of one day* la order to conduct evalu- 
ations of new methods and curricula, we have set up procedures which 
consider data at a rate and con^lexity which exceeds anything 
attcaq>ted by any of the testing companievS in the U* S* ten years 
ego, and we do these things in order to help our teachers and 
supervisors with today*s problems* We provide a possibility of 
continuous assessment of school programs in order to provide an in- 
formation base for prompt program planning and revision * 



AJWay to Live with Reseayeh 

Ih Oakland Schools, we are learning how to live with research* 
Since it is no longer something you oan take or leave, or even take 
from time to time, we take the long view; we live with it* This 
means that practitioners have as a requisite service, the use of 
coD 5 )et^t system designers and tochnical consultants* The knotf-how 
13 provid^, not only to do the job bit to teach the practitioner 
to use and control the whole procass* 

Hopefu2J.y, the result of such efforts will be the development of 
a new kind of school administration, one in which research and evalu- 
ation is not only a tolerated part of the process but is the very 
senso^ organ which guides administrative progress* This is only 
1 ^ "when technical assistance of a high order is pro- 

vided, together with good data processing capability* 
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These prerequisites of research are built into the administra- 
tive organieationt and occupy a imique position in staffingt in that 
the research staff is independent of other staff functions. In this 
wayt each other staff person is free of organizational restrictions 
in using research technological services, bikewisot the ret>sarch 
staff has no direct responsibility for conducting other administra- 
tive functions. 

This sort of staffing structure results in the responsibility 
for Initiating research activities resting with educational prac- 
titioners and their supervisors. The services of the research 
department are as available to a teacher who wishes to desi^ a study 
of method as they are to the administrative head who wants a design 
and program for a long-range study of educational efficiency. But 
in neither case does the research technologist Initiate the study. 



ConmuniGating about Research 

One of the best reasons for conducting research studies in the 
situation and the cont^t of the education practitionert is that 
which has been called the principle of Involvement, This principle 
is simply that it is easier to inform people about research when they 
have been involved with it as it took place. It is true that there 
is an apparent bias among educators to place more value on the word 
of from afar than upon their own experiences t but this bias 

is more effective when it comes to planning group activities for 
in-service training than when planning next year's staffing pattern 
in the school, 

A cornplem^'tary feature of the principle of involvement is that 
good research activities tend to attract kibitzers from other places; 
people who have come to see for themselves that new program being 
tried in the hinterland. This adds status and even glamour to re- 
search involvement. 

Of course, research is of little effect without publication, 
VlGro again the uses of the past are not adequate, because the 
^4Sitionally distributed professional journals are insensitive to the 
y^eeds of local school researchers. Of course, it is an excellent 
thing to be published in that way, but such publica'ulon is too slow, 
too costly, and too undependable to begin to do t?»e publication job 
needed. 3h any case^ the first task is to prepare a research report 
for the use and edification of those who are directly concerned. 
Mimeographed or photo-offset reports are useful for this pui^ose# 

Don't stop with merely local distribution of j^ur report. Mail 
them to libraries, local institutions of higher learning, and your 
professional colleagues everywhere. Always mail them only to people 
by name, and let it be Imown that additional copies are available. 

The costs of such self -publication should be justified as bread upon 
the waters. 
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There is a saying in academic circles that om must publish or 
perish* I would caution you not to do both* The quality cf your 
research will be evident to the reader of your report* If it is good 
research* poor reporting won*t kill you, but it will reduce the number 
cf people who want to hear about it. Some people get by for years by 
hiding poor research in glossy reporting, but that*s unprofessional • 

My own test of good research publicatlcTi rests on the local reac^n 
to it* If ?i.ocal people are motivated to undertake) further steps in 
research because of what has already been done, your communication is 
a success, and so is the research* 



Fln?mcing Research 

There are plenty of people who know Piore about soft-money 
financing for research than I do* Soft'^ooney is the kind that is 
obtained on a project basis s usualiy from some ’’outside” agency like 
the government or a foundation* It is money that is to be used only 
for that particular project, and it may or may not be extended or 
augmented if the project needs more money or if it leads to other 
projects* It*s soft because you can*t use it to build up a permanent 
research staff or facility unless you are gocd at maintaining a con- 
tinual flow of more soft moneyc Soft laoney has the further dis- 
advantage that the source of money usually has some way of keeptog 
a string tied to the researcher for the pui.*pose of ensuring that the 
research results meet some previously clete’pmins^d i*.pQct?.bion. 

The structure I have been talking; about is based on hard money 
financing of a research staff, but it does not preclude the use of 
soft money for particular projects. Here again, the responsibility 
for project financing rests with the initfiator of a project. Of 
course, if the initiator is a classroom teacher, soft money financing 
will not be obtained without including an. administrative person (other 
than the research staff) as an applicant, in the name of the corpora- 
tion, for project funding. This is prob^ibly a good thing, because 
teachers can*t initiate research T^riLthout administrative help— if 
they do, they wiH get administrative hindrance*. 

Hard money financing of research should include money for 
teacher-initiated research* Usually the costs are very minor, and 
the ^tra time that local teachers will devote to such research is 
clear gain to the corporation* 

There is more to research than getting it funded as a project, 
as many people have leamed to their sorrow* Once you begin a re- 
search project, it should be followed through to the end* It may 
seem all too obvious to say that you have to look ahead to see what 
that end may be, before you begin; but that is just what many people 
fail to doa' These unfortunates find themselves, one fine day, the 
possessor of a pile of unprocessed data, and they don*t know what to 
do next,. They had failed to look ahead* Occasionally it happens that 
such a person never recovers from the experience. As Shakespeare 
says, ’’the piay^s the thing.” Don®t let your skill as a fund raiser 
get you into a game you can*t play* 



"Reaction to Dr. Joos* Presentation" 



by Dr, 



Gordon I. Swanson 



♦ 



I m reminded, first of all, of the college counselor who was 
speaking to the high school graduate who came to him to see if he 
should submit an application for admission to college. The counselor 
said, "Are you in the top 10^ of your class?" and the student said, 
"No, but I think it*s possible." I think as Ray told you at the 
outset that this (Joos-Swanson) is a pupil-student relationship- 
one that makes one of us possible. And because of this previous 
relationship I have had with Dr. Joos, I can tell you some things 
that others wouldn*t be able to tell. Now, while Dr. Joos has no 
vices, he does have some sets. One of them is to get ay goat and v. 
other is to take an extreme position just for the effect of the 
position. You will note that in his paper he pulled in an extwrae 
amount of pragmatism and for this he expects your questions © 
ix% s little bit of Conant and the Ancient Mariner crept in. I should 
alsc tell you that what he says he believes <. He did make the con- ^ 
elusion that I hope jcm drew, as I did, that there *s no question 
we* re going to be involved in research in vocational education. The 
question of whether or not we*re going to be involved is not a 
question at all; the only question is whether we*re going to do it 
well - how we see the riles of the game; how we see the game in the 
first place and how we keep the score. 



I have just a few comments I would like to make on his paper. 

He began, you recall, with this disclaimer of who was an active re- 
searcher and he said that anyone who did the kind of research which 
is conducted in, for, and by colleges and universities, this cateogiy 
he would av and this he removed from the category of active re- 
searchers here is an area where he expected to get uy reaction— an 
I*m going to give it to him. The college and the university is one 
of the only institutions in this country that employs the supply of 
manpower that is prepared with research degrees. It is one ^be 
only institutions that is in the business of absorbing the kind of 
research confidence that Dr. Knox talked about this morning. Now, 
it is true that school systems do employ people who have research 
degrees and the Pontiac system is a good example. Indeed, it is an 
unusual example, I believe, because in the field of education, com- 
pstrdd with alinost all othor riolds of rosoarchf thoro aro very x€W 
people spending a full career in research. Usually, research is a 
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part of an academic career. How many people do you know who are 
spending a full professional career cn full-time reseawn? lou 
find them W the' score in the field of physics, 

in chemistry. You can find them in tiie space and defense industries, 
but In education how may do you know that are spending a fuU 
fessional career in research? And if inde^ there are , 

who are willing to employ people who want to spend * 
career in research in education, whore are these institutions? Ana 
what are the most likely institutions? ^‘That time can you biy in re- 
searchers and In \Aixt institutions nay you find them? 



It seems to me that any time we conside- the research component 
of any field, or whatever game we*re playing, and if we want to 
large this, we need to capture the time of competent researchers, ^a 
we have to capture the time wherever we can find the researchers, it 
seems to me that there is an la5)ortant body of energy going on some- 
place by people who h&ve v^chievod sow© level of conpetence# ^ s 
important not tc avoid this research effort in colleges and un*- 
versitieso He *11 come back at me on this, but this you understand 
was a disclaimer at the outset. 



He also pointed out, and I think rather properly, ^en you 
do describe the lules of the game that you do not describe taem 
narrowly, because then you restrict the kinds of questions which 
should be asked. He mentioned that the object of vocational and 
technical education is to traiji people for gainful employmOTt^^^d 
we have a rather specific measure to success. ^4hen he said, do ^ 
not look at this narrowly, look at it broadly," I would suppos© 
he would suggest that even the Dictionary of Occup^ ional Titles has 
a great many titles that are not really filled according to the 
labels that are presented there, and there may be a great many occu- 
pations that are not found in the Dictionary. He also emphasized, 
and I think quite properly, that the ultimate as well as the 
immediate goal is terribly important. And then one might question 
where the ultimate goal ought *:o be exssdned - whether the ultimate 
goal ought to be examined by the porson who is teaching at the 
elementary or secondary level or where this practitioner can be 
found. And practitioners, I presume, includes anyone. He also 
emohasized, and I think quite properly, that you cannot ask the 
question in this way: "I want you to sfedy what you are doing and 

•te think of bettor ways in which to do it. " He said this would lead 
to rather sterile kinds of questions being asked. And I think this 
is very, very appropriate. I think we have some good illustrations 
in modem industry to draw that this has been the approach by some 
industries and that it hasn’t woiked very well. The railroad in- 
dustry was doing its b^st to restrict its own racket; to see how it 
could do a better job »f carrying freight. It was trying to improve 
the schedules, trying ’> make rounder wheels and so forth, and in 
so doing they completely forgot that the airlines business was doing 
something else. And now, the airline business has stolen the rail- 
road’s passengers. There was a different school of practitioners 
operating at some other institutional level. And you’ve heard the 
old saw about how to improve illumination. It would have been quite 
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possible for the nanufactazers of lamps to make wider wicks# bigger 
globes# and larger lamps# and if this had been the only effort the 
light bulb would never have been discovered. There is a different 
level of practitioning going on and it seems that In the field of 
vocational education# one needs to harness up nil the energy avail- 
able# wherever it is and at any level of Innovation, Joos wnphasised 
this* also# a need for establishing an appropriate theory# and here 
he agrees with Ihio^, 

He said that there appears to be a system and a moving system; 
in other words# you cannot djrive two stakes to see where this is 
going# because in a moving system the stakes are also moving as well 
as the system. Theory is important and merely doing better is not 
sufficient \mtil you define what is meant by doing better. Ho 
mentioned the fact that one of the ways to stimulate research is to 
attack the "sacred cows" and he said that this would provoke people. 
Here perhaps is another place where I could come back to his avoidance 
of colleges and universities and even state departments of education. 
Maybe it would be quite appropriate to examine "sacred cows" wherever 
you find them, I have a personal feeling that many of the courses in 
colleges pf educa'U.on that are entitled measurement# measurement in 
education# should be re-labeled. These are incorrect labels. They 
should t called ’l-Ieasurements of Psychological Variables in Edu- 
cation" and then admit that there is no course that teaches people 
how to measure sociological variables# or economics variables# or 
cultural Variables, To be thus more honest to use a limiting 
label rather than a general ono. And# there may be some advantage 
in this for vocational education, because it is possible that the 
difficulty (for example# the difficulties of getting even the 
poverty program#at least its educational aspects off the ground) 
is the fact that we are measuring the wrong thing. Or at least 
maybe we have no way of measuring the right thing? This is a per- 
sonal bias of mins that we might discuss later. At any rate# it 
seems to me that a great many of the variables that need measure- 
ment# we can*t measure— we only categorize. This is no criticism 
of the ares of educational psychology because there they can measure? 
primarily because the instrumentation has had more work. There are 
many areas of education where instrumentation is not in good taste 
for the kinds of problems w© want to deal with. It does seem to 
me that the development of instrumentation would be a good role for 
research coordinating units— if th^ can stimulate this kind of work. 
And I also have the feeling that the practitioner in this case is 
located in a different institutional arrangement. 

Ho also gave some attention to the role of categories a»^d 
labels. And here he moved back to the discussion of theory# or to 
the game wo*ra playing. As a matter of fact# it*s possible I think# 
when we’re talking about labels and categories to say it’s almost 
isipossible to talk about education itself without talking about only 
the forms of education# in the same way that it’s almost Impossible 
to tails about religion# whether it’s the gospel according to Knox 
or Joos# etc, 3h religion we talk about the forms of religion and 
it’s ali©3t luqQOSsible to talk about religion without talking about 
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its and labeling thus, merely identifies the particular form 

we»re discussing at the moment. While it*s true that maybe some of 
the labels ought to be renewed from time to time, they are a deterrent 
but also an asset and they can work both ways. We hope they are 
descriptive, but they’re not always descriptive. Some of the labels 
that we think are most descriptive are not descriptive at all; some 
that we accept so fully and conqpletely# are on the can^^us of a 
"land Grant University. " Try some time to translate that term -nto 
another language; yet we seem to know what it means when we use the 
label. Try translating it into Spanish or French or some other 
language that you know. 

This is about all of the comments that X have to say except 
that Dr, Joos did ei!5)hasize the high level of competence needed and 
this was an emphasis which I hope will continue in the RC^ efforts. 
And he did not end up by saying something about hard money versus 
soft £!oney# This is an administrative question, that I thi^ v.4 
exceedingly important. I don’t know whether we should get into this 
here or not, but I do believe that it is terribly important to leam 
how to us© soft money as though it were hard. That it’s impossible 
to have a very sizable research program on only soft money if your 
operational program is on hard money. This puts the whole thing out 
of balance and I will agree with him completely that too much can 
be risicy— the risks of success in getting money can put high risks 
on research itself and I’ll wind up by saying that maybe ^one of the 
most risky things that could happen to any RCU would be lor ail oa 
them to be successful and each given a million dollars the next time 
they try; this could kill them off, because there probably isn t 
enough of the in-put kind of things that Dr. Knox was talking about 
to do a good 30b with the output that should be expected from that 
kind of resource. 




ORGANIZING FOR IMPLEMENTING CRA!IGE? IN EDUCATION; 
SOI® IMPLICATIDNS FROM AGRICOLTORE AND 
DFFOSION RESEARCH 

by Herbert F, lionberger* 



This paper is directed to the broad problem of organizing effort 
for implemented change in education with inferences that may be drawn 
from organizational methods us^ to agriculture and from the various 
diffusion research traditions, 



basically the problem to which we are address tog ourselves is 
little different from the one central to the operation of apicultural 
colleges to which r.iral sociologists have worked; namely, that of 
developing, validating, and disseminating scientific information to 
students and the public.^® 

Diffusion research, which I claim as my main area of speciali- 
zation has been defined as "(1 ) acceptance (2) over tim© (3; of some 
specific item, idea of practice (4) by individuals, groups or other- 
adopting units, linked (5) to specific channels of commEacation 
(6) to a social structure, (?) and a given system of values or 
culture, "31 The earliest research done in the agricuitural diffusion 
research tradition was by the Cooperative Agricultural Bct-ension 
Service, whi.ch was charged with the responsibility of aisseminat»ng 
accumulated scientii'ic information from research sources to farmers 
who could ir/ike use of it. Rural sociologists became involved in tbs 
early 1940^s after which several himdred studies have appeared , 
mostly of recent date,®3 Other diffusion research oraditions 
developed somewhat simultaneously or later to ^thropology, public 
health, education, and in business, with a tendency to corroboration 
of findings from the various traditions in recent years,^ »-> 

Speaking prtoarily of the agricultural diffusion research 
tradition for which rural sociologists were primarily responsible, 
attention was directed mainly to the adoption of rather simple agri- 
cultural practices by individuals and to decisions of a rational, 
del.iberate nature; also, to channels of communication and influence 
involved to the acceptance processes as well as to the way to wha.ch 
adoptions aggregated in localities. Before enumerating generaliza- 
tions and concepts from this tradition which may have a bearing on 
the adoption of innovations in education, some basic differences 
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between the two should be noted, both with immediate utility of 
findings on the one hand and organization of effort to enhance 
adaptibility of school systems in view. 



Differences and Umltations 

(1 ) In agriculture, individuals are the .a doption unite. 

Although in the final analysis individuals must decide, school systems 
are also in a sense adoption units. ^7 The school superintendent or 
administrator has been the focal point of x’esearch with considers e 
difference of opinion expressed in regard to his potential TOle as a 
change agent.25t7^»11 »23562.16 Whatever this may turn out to be. he 
certainly is subject to more social pressures from outside in^u- 
ences than farmers who have been the focus of attention ^ 
research in agriculture, Xet. the administrator is the authority 
figure in the system, which means both he and tee system can be 
highly instrumental in inqolementing change.”*' *^ 



(2) Rewards to farmers who adopt new practices are much, more 
di rect, easily ascertained, definite, and p erhaps. le_ss subject.tQ 
anticipated consequences to the adopter _t han innovations in education. 
A farmer can save money, make more profits, save labor or time, or 
derive other benefits of direct and easily assessed benefit to hto. 
Even worse, tee teacher or administrator may become a victim of h s 
own innovative effort® Pay increases and promotions are made mainly 
on the basis of years experience, college degrees and perhaps, on 
ability to keep things running smoothly, not on innovation. In 
fact, one study has shown that innovation is very little a part of 
a teacher *s conception of what it takes to make a good teacher.^ 

To moralize a little, it would be unfortunate if adaptive efforts 
in education are not favorably recogr.ized and rewarded, consider- 
ing the need for such innovative effort. 



(3) T eachers and administrators may be more v ulnerable to de- 
valuation of existing skills tha n far mers ^d at least some^^ pro- 
fessionals because of changing technology. Furthemore, positive 
incentives for the acquisition of new skills may be quite lacking; 
also, the means of eliminating or even bringing effective pressures 
to bear on laggards. The famaer who is not alert to changes in fac- 
ing and who does not adopt improved farm practices readily is xikely 
to be eliminated. Megative sanctions do not operate to the same 
degree and manner in education as in agriculture; also, teachers may 
actually exert pressures on others not to adopt changes which will 
inconvenience them.^^ 



(4) Most of the diffusion research in agricu lture has been 
directed to relatively simple agricultural practices w hich can be 
adopted individually. However, those in education are often more 
complex, less visible, and more difficult to assess from a utilitarian 
poirit of view.50tb2 

(3) Organization for change is differentc Msuiy differences be- 
tween in^ilementing change in agriculture and in education stem from the 
way each is organized for that purpose. In agriculture, functions. 
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operation f and organization atb highly institutionelized in contrast 
to educatton.2^ To be more specific i organization and testing of 
scientific farm information under field conditions and conmunicatlng 
it to users is a special function manned by specially trained pro- 
fessionals in an organization that is designed for that purpose* 

Passage of the Hatch Act in 1887 clearly moved the development of 
agricultural information from the realm of folk knowledge to the 
laboratory or experiment station where scientific methods are • 

applied to developmental and testing efforts** Passage of the Smith- 
Lever Act in 1914 establishing the Agricultural Extension Service 
clearly recognized that disseminating information and practices was 
a specialized business for which specially trained personnel i well- 
directed effort, and an appropriate organization was needed* In 
addition, many linkages with other systems** which assist in the 
Information disseminating efforts were established* At the receiving 
end of the line, confidence has been developed in ^at is offered, a 
continuing expectation of new things to come, and habits of using 
facilities and information outlets from the central system* 

Another \mique feature is attention to application skills and 
provision of specially educated change agents* They appear to be 
regarded as essential to any substantial program of directed change, 
9*g*f soil conservationists in soil conservation, county directors in 
extension education, community developers in community development, 
health educators in public health to mention only a few* Yet those 
functionaries would be almost useless without the supporting systems 
in which they operate and without perfection of their respective roles 
as inteisnediaries between systems which create scientific tofor^tion 
on the one hand, and the potential users on the other*5o,7o,77#19t7 

^rhoever controls supplies can greatly Influence innovative be- 
havior »i In this country, supplies for agriculture have been taken 
quite for granted with the free enterprise system quite adequate to 
provide what f aimers need when they need it* Lfi developing countries, 
this has generally been combined with the extension education function* 
However, in introducing nev^ supplies to farmers, such as agricultural 
chemicals, experiment stations have often been used as legitimating 
devices* Thus, some commercially developed products are tested by the 
various experiment stations « Conceivably, supply systems operating 
quite independently from research and developmeiit can either facilitate 



*l^iles uggested that similar shift took place in education 
about 1957 wht... .innovation in school curricula was removed essentially 
from individual responsibility to a coordinated enq)hasis on directed 
change agents outside of school systems *75 

**System is defined by lUles as ”a bounded collection of inter- 
dependent parts devoted to the acoon^lishment of some goal or goals, 
wit»i the parts maintained in a study state in relation to each other *s 
and the environment means of (1) standard modes of operation, and 
(2) feed-back from the environment about the consequences of the 
system actions**’ (46, p* 13) 
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or iuhibi'b &cceptsnce of innovations* 6«g«* textbooks can materially 
influence curricular offerings* Commercial agents may eii 5 )hasize 
uni(^ue features to sell their products and in tum change by 

reinforcing decisions to retain the obsolete* a practice which has 
some utility for the user also *50 

Some IfliDlications from Agriculture for 
Organiaing ilmplemented Change Efforts 

The prior organizational situation organizationally is a con- 
sldeiation in developing plans for directed change in education as in 
anything else* 3h education there is no wealth of experience as in 
agriculture for organizing and directing such efforts* but neither 
is there a tradition to hamper nevx developments; this despite the 
diverse and complex organizational aspects of education in the 
United States** Attention could be focused on the organizational 
requisites at this point* but consideration of the necessary functions 
probably would be more fruitful* Thus* four are chosen for con- 
sideration; 

1 * Originating and validating scientific infoimation 
and innovations* 

2* Disseminating Innovations and information to 
potential users* 

3* Teaching skills to change agents and potential 
adopters* 

4* Legitimating innovations and infoimiation* 

Some might add integration of innovations into the life patterns of 
adopters as a function.23»62 i am subsuming this as a part of 
adoption* 

1* Originating scientific information. The first concern is 
with the development of innovations* These derive generally from in- 
vention and borrowing* Certainly no opportunity should be lost to 
borrow but greatest reliance must be on invention. Some innovations 
might come from folk knowledge or practice. For a long time farmers 
insisted that one learned how to farm by farming* and that new develop- 
ments in farming came from the same source* There is still some truth 
in this contention; also* the years are not long past when innovation 



*Mles has enumerated public and private school systems, a great 
variety of governmental* and private educational programs, regional edu- 
cational associations* government agencies, commercial s'cructures in- 
cluding vendors of educational materials* suppliers of building and 
equipment, knowledge producing and knowledge applying organizations 
ai\d mass media, dozens of non-profit structures primarily devoted to 

educational iB 5 >rovement and change, and a host of special structures* 
all common in educational organization today,^ 
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in education was left mainly to individuals and local school systems ,75 
Surely some good ideas have been developed by ingenious educators and 
will continue to be, Thust some means of innovation retrieval is 
needed even though education like farming has long passed the folk 
knowledge stage. Perhaps the kind of feed-back is more important 
as guides to needed research and testing than as sources of validated 
practice. 

Another possible source is "eoqperts" peripheral to educatir^ 
which* in this case, may include psychologists, sociologists, 
political scientists, and the like. Certainly such sources ought to 
be exploited, one method being conferences such as this one, Lippi tt, 
at the University of Michigan, has formalized this procedure somewhat 
by arranging periodic conferences with likely contributors from the 
social scienc 0 s ,^2 a weakness of these approaches is that potential 
contj;*ibutors already have full schedules and thus may not be able to 
become sufficiently involved to realize their full potential, 

A third way is to make innovation somebody *s business, with an 
appropriate supporting organization. This recognizes that there is 
more to innovation in education than folk practice and the fleeting 
thoughts of professors including the diligent efforts of a pro- 
ductive fewo 

Just what the organization of effort should be in the future 
is probably open tc question. Experimentation with a number of 
structural arrangements as a prelude to formalization may be ad- 
visable, '£n agriculture the resident teachings research, and ex- 
tension trio has worked well, but is only one of many alternatives, 

A number of others have been enumerated by Miles 

The question of whether research and development should be 
lodged in existing school systems or in some kind of a peripheral 
one may eventually be resolved in favor of the latter. It is doubtful 
if schools experimenting on themselves with other major responsibil- 
ities assigned would be the best arrangement. Some means of bypassing 
vested interests, of protecting innovators, and rewarding their efforts, 
even though sometimes unproductive, are needed. This would be diffi- 
cult in most school systems. Also, it xrould appear that objective 
testing and sustained experimental work may be more possible in autono- 
mous or semi-autonomous systems, 3h fact, it has been suggested that 
the most innovations in education have developed in essentially 
peripheral organizations, 50 

Hwjever, external research and development systems pose problems 
of keeping in touch with the action world of reality and of keeping the 
research reasonably aligned with the developing needs of educators 
while reserving some resources for ”basic" research, la the absence 
of effort directed to this end, linkage will Ttikely not occur. Also, 
organizationally the advantage of associating educational research with 
resident teaching as a device for the sducaticn of teachers should not 
be overlooked. Undoubtedly this kind of arrangement in agricultural 
colleges has resulted in more realistic education of change agents on 
the one hand, and an enhanced competence in researchers on the other. 



L 






31 



Another immediate need in research and development is a hatter 
means of collecting, analys?ing, and collating research findings from 
an expanding source of supply. A system of indexing and abstracting 
adapted to IHd card processing now being used hy Rogers in diffusion 
research and similar methods ^ing developed in medical science may 
be helpful.* 

Orgardzatiorially, the question of teo^orary vs. pemanent 
structure may also be posed. There are pros and cons either way. 

Miles suggests that much energy in permanent organizations is often 
diverted to routine non-proihictive efforts in contrast to temporary 
systems which are alleged to enhance information exchange, hard work, 
team effort, and compulsive group action. 51 

Even though teaqjoraiy structures may continue to be used for 
innovation in education more or less permanent organizations staffed 
with special research talent will surely he required to generate new 
ideas and to test them under field condition. Teachers and ad- 
ministrators must have field tested innovations upon which they can 
rely because costly mistakes must be avoided. There may be a question 
about the supply of such. Change agents in agriculture generally feel 
little obligation to argue the validity of the practices after they 
have been tested thoroughly in esq)erim 0 nt stations and would generally 
have a plentiful supply of practices to recommend. Furthermore, it is 
very inqportant that changes recommended to rank and file teachers and 
administrators he of essentially unquestioned merit, the assumption 
being that their innovative role should be largely confined to pro- 
moting carefully validated practices. 

2. Disseminating information. After innovations have been 
developed and evaluated, knowledge about them and their utility must 
be disseminated to potential users. This constitutes the second 
functional requirement for implementing change which in turn entails 
a variety of specialized skills, specially educated functionaries, 
specialized technical information sources, and organized effort. Even 
though it may not be generally recognized, there is a specialized 
technology of implemented change quite aside from other specialized 
skills in education; this is attested to the voluminous research 
and writing on the subject. Studies number well into the thousands 
and cut across the fields of sociology ^ psychology, social work, 
extension education, journalism, economics and political science, 
along with others.*’^ With the ^dy of knowledge implied by this 



Rogers at the Department of Comnranications , College of Com- 
munications Arts at Michigan State University, is maintaining a con- 
tinuing operation of abstracting and irdaxing diffusion studies from 
which studies of a particular type or subject matter can be obtained. 

An estimated 5000 studies in one way or another relating to com- 
munication or implemented social change was abstracted by the National 
Project and Agricultural Communications, headquartered at Michigan 
State University. 




32 




research, it necessarily follows that acquiring proficiency as a 
change agent is in addition to and .soiBetimes quite apart f roro 
acquisition of knowledge to be transmitted through the information 

disseminating system# ‘ 



•4lso, a general belief prevails among agricultural college 
personnel that researchers are ordinarily not good extension people 
and the converse, in any cas©, the education accordea each is quite 
different, both at the graduate and undergraduate level. 



Furthermore, the service, supplies, and support that an extension 
nerson needs to do his work almost requires that he be a part a 
system which makes this possible. Research becomes a matter 
concern to the degree and manner in which it enhances a better under- 
standing of change processes and conditions. 



In education as in agriculture, knowledge is suffieientty 
specialized to need continuing access to information specialists. 

The question of where to place them in the organizational xi-amswor 
naturallv arises. Because specialists have professional reference 
group ties which may often be stronger than those to 
disseminating system, provision for a working relationship with tneir 
own profession is essential for recruiting and retaining them in change 
agent roles; also, for maintaining proficiency in their respective pro- 
fessional fields, hi agricultural extension systems, the attactoent 
problem is solved by allowing specialists to retain their aepartmental 
connections. With local agents in direct communication with people wno 
are targets of change, they provide information feed-back about re- 
search needs which are in turn communicated to researchers. 

An alternative to information disseminating system interposed 
between information originator and user as above described, is direct 
communication between scientist and consumer. Another altem.ative 
might be to place researchers and extension educators in a single unit 
charged ^lith developing f directings orienting t and evaluating edu- 
cational efforts which under other circumstances has shown some 
promise.22,68 Use of temporary systems for specific purposes offer 
another possibility but surely would be inadequate, 51 

3, Teaching skills to change agents and potential u^rs. This 
is a third requirement for getting scientific information and in- 
novations used. For change agents this is accomplished through resi- 
dent teaching in the agricultural colleges and through continuing 
in-service education. Target individuals are taught application sku.lls 
by a variety of extension education methods. This helps dispel fears 
and forestall failures which is particularly important for early 
adopters. The documented role of early adopters in communicating in- 
formation to those who accept later and in convincing them to try new 
practices stands in evidence of this contention; 59, oO also, the 
disastrous results of misuse of perfectly good innovations in edu- 
cation. 50 
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4* Legitimating irmovations and scien tific information. 
Legitimation of new ideas and practices is in some respects a system 
function and in other respects nott depen«iing on what adopters require 
for own acceptance. For those who are willing to accept evidence 
direct from the scientist, legitimation is mainly a system function. 

For those who require local trial and advice it may be essentially a 
primary group function. Since several legitimation levels are required 
with trusted personal referents heavily involved, it is treated under 
Implications from Diffusion Research, which has contributed materially 
to knowledge on the subject. 

Implications from Diff us ion Research,, for 
Facilitating Changes in Education 

Only superficial reference can be made to substantive findings. 
These are adequately summarized in other publications,^ Whereas the 
focus of attention has been on organizational implications up to this 
point, implications from diffusion researcth relate mainly to the needs 
of individuals in accepting innovations, hi one sense, individual re- 
quirements and conditions influencing individual decisions reflect the 
state of institutionalization of change promoting systems in agri- 
culture and in another sense, the functional requisites for enhancing 
adoptions 0 The procedure will be to briefly enumerate findings from 
selected substantial areas and to point out relevant implications, 

1 • The i j^vidu al adop t ion process. The much used individual 
adoption process of awareness, interest, evaluation trial and adoption 
has greatly facilitated the conceptualization of fiinctions involved in 
arriving at adoption decisions and in assessing the use of information 
sources at different stages,**^ 1?2 Mass media of little importance 
as a major reason for the adoption of faim practices^ determined ^ 
methods used in early diffusion studies70 proved to be highly important 
in creating awareness and Interest when the newer model was used, 

’’other farmers” are paramount at the evaluation stage,! ihO 

Perhaps demonstration that adoption is a process and i\ot a unit 
act is also importanto Mundane as this finding may appear, much early 
diffusion research and educational effort did not recognize 'jhis xunda- 
mental facto?® The process idea en^hasizes both tii3ie and sequence of 
influence considerations, while in a sense stages represent functional 
requisites for arriving at decisions requiring thought and deliberation 
The time dimension holds that people ordinarily do not adopt new ideas 
or practices as a result of a single influence or immediately upon 
hearing about them* Time is involved in both the sequence of stages 



*Among others, Idonberger (^) and Bohlen (4) havo prepared papers 
on the subject while more complete treatments may be found in books by 
Rogers (60) and Lionberger (36). 

^^Limitations of the model, not unknown to the originators, have 
been ably pointed out by Hassinger (2^), Mason (^5)t Campbell (8), For 
a description of the model and its Implications, see Rogers (oO), 
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that individuals go through in arriving at decisions and in the way in 
which adoptions aggregate in a given locality. The time span between 
awareness and adoption may be a matter of years t months * or possibly 
only days. Also the time required for maximum adoption in a given 
locality has been found to vary from a few months to 50 years or 
more,66,67,9»54t13 

To the extant that stages represent functional requisites in 
arriving at decisions, they are useful in assessing the adequacy cf in- 
formation dissemination systems or partial systems. Thus Miles hao 
used the stage construct to assess the adequacy of various structi^al 
arrangements for in 5 >lQmenting educational innovations, in regard to 
individual adoptions, Eicholz and Rogers suggest that the model can be 
used to classify adopters in teims of liicely needs for facilitating^ 
the adoption process. Thus, they suggest that rejection for lack of 
knowledge is an awareness problem and by default or to maintain the 
status quo an interest problem,21 

2, Functi onAT iss in the Individual adoption process, in- 
dividuals like iiifcniation sources perform different roles in the 
individual adoption process. Some serve as innovators, some essentially 
as communicators, and others influentials or legitimate rs , Those first 
to adopt a new practice in a given i' "lality (here referred to as in- 
novators) perform a ’‘local trial" function, help adapt znnovations to 
local conditions, and assume rijks that others cannot afford or are 
not willing to take eveii though they themselves may be relatively 
securec^^ Since many fanners want to see a practice tried locally 
before they use it themselves, innovators play a very important role 
in influencing and educating others, thus a possible reason why in- 
novators sometimes occur in clusters,17»50 

Among those sought as sources of fairo information, some are in 
more demand than otherq also, still others may be sought for advice. 

Not all communicators of information are taken seriously or sought 
for advice; thus the distinction between communicators and legiti- 
mate rs, 41 

A Missouri study shovjed that the distinctive characteristic of 
communicators was social accessibility while influentials or legzti- 
mators seemed to be most characterized by respect for good judgment 
and management abilitya4l Both were distinctly more receptive of new 
ideas from outside of the immediate locality, had more such contacts, 
and were apparently more able to apply abstract knowledge to own 
situation than most other farmers. Thus, they provided avenues of 
ready access for change agents and acted as inteime diaries between 
scientific sources of infoimation and those who used it. 

However, in situations where local norms dictate caution in 
trying the new, innovators may be watched but not followed, with in- 
fluentials being somewhat less receptive to the new ideas being intro- 
duced, ]h this case, one educational approach might be needed for 
innovators who are highly receptive to nex-r ideas and one for influ- 
enbials who may need some convincing. 
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Cdrtciiiily thor© is a H 66 d to detoimin© who th© special functi< n» 
aries are in th© adoption of educational changes and their character- 
istic j pertinent to the diffusion processes, much as Carlson has done; 
and incidentally with important parallels in findings from agricultural 
diffusion research*^ 

3 . of ideas and infoiroation, legitimation, of 

which we have already written, may be defined as th© process by which 
fears are dispelled and acceptability of the new is achieved* 
is conceptually different from mere acquisition of infoniiation. » 

Since there are different adopter clienteles involved in the 
processes of disseminating scientific infoitaation from scientific 
source to ultimate consumer, legitimation requirements are likely to 
bo different at different levels, e*g*, between those required by 
cjiange agents in agriculture and those is^>osed by faimerse Ecen among 
the latter, requirements are likely to vary for i^ovatoi-s, com- 
municators, legitlraators , and the average f aimer* 39 

Change agents in agriculture are the products of the same in- 
stitutions that develop much of the knowledge which they eventually 
disseminate te farmers. Through the resident teaching activities of 
these institutions, change agents leam to respect the method by which 
now ideas arid practices are tested in the Kcperiment station and for 
those responsible for the recommendations* Thus, after graduation, 
knowledge that new ideas have been tested in an e^eriment station 
and are pronounced satisfactory is usually sufficient* 

Although a few farmers may accept something direetty from the 
scientific laboratory^®*^"^ most will require more and indeed a 
different kind of proof *38 Even those who serve as legitimators 
for other farmers, may want to see the innovation build locally before 
trying it themselves. Thus, local trial by fellow farmers with the 
requisite eEsperdlence and reputation for good judgment may be required 
quite aside frem what experimental results- show or what agricultural 
specialists say* Brickel found much the same requirement imposed by 
teachers in Wew York state, in accepting innovations also, Barton and 
Wilder in the acceptance of reading instructional methods *0# 5 

From an action standpoint, these findings suggest the utility of 
capitalizing on the manner in which legitimation occurs* and from a re- 
search standpoint^ deteimination of what the legitimation requirements 
are for change agents, inteimedi&ries> , and direct users of scientific 
infoxmation as well as the characteristics of each pertinent to the 
diffusion processes. 

Teachers like farmers may b«» ’-eluctent to accept innovations 
developed 'inder conditions regarded as essentially artificial and thus 
also require ad'’/ice and assurance from trusted others as a prerequiste 
for accepting educational innovations,^ 

4. The adoption curve, Huch has been written and said about 
the S -shaped adoption curve, which is merely a graphic representation 
of the manner in which adoptions aggregate over time in localities 
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£5uch as coimmmitias I states* or regions, This curve has been 
characteristically derived from situations where adoptions have been 
successful. If failures or near failures had also been considered, 
the results would have been different. Thus, in a sense, the 5-shaped 
carve is something of an ideal model for jchange agents but nevertheless 
one that they can realistically hope to achieve. 

Significant features are for adoptions to start slowly, to in- 
ciease at an increasing rate and finally decline. There is good reason 
to think that tlie accelerating pattem results from the interaction of 
people with people and the way in which they influence each ether. 

Thus, part of the secret of getting quick adoptions is to facilitate 
these processes. This suggests the desirability of opportunities for 
teachers and administrators to exchange ideas, and compare notes on 
innovations which they have tried or expect to try. 

Although innovators V communicators, and legitimators are involved 
throughout the diffusion processes, the intensity and nature of their 
involvement varies at different stages, Innovators by definition are 
most involved early in the diffusion processes, Ihfluentials or legiti- 
mators are probably mainly responsible for the rapidly facilitating 
effect after the slow initial start,60,18 Thus, when influentials 
and/or legitimators have adopted, others follow in rapid succession, 
because they are generally im>re socially accessible and more receptive 
to new ideas and information from outside sources, they can serve as 
change facilitators ,38, 29, 33 In fact, influentials (legitimators) may 
acquire information for the purpose of communicating it to others as a 
status enhancing device quite aside from other uses,^® 

The conformation of the adoption curve also has implications for 
the amount and kind of effort that needs to he exerted at different 
stages. The first adoptions are achieved only with considerable ef forte 
This is recognized by county extension agents who quite habitually con- 
centrate effort at the early stages of the diffusion process, 71 It is 
during this stage when new ideas and practices are being legitimated 
locally, that additional effort to convince local legitimators is 
warranted. After locally influential persons have adopted the new 
practices, perhaps the major change promoting problem is diffusing 
the locally legitimated innovation. Finally when a majority have 
adopted, reinforcement cf decisions may become the main problem. 
Agricultural change agents have been little concerned with this be- 
cause acceptance of the new in rapid succession is desired and pro- 
moted, Perhaps there is also an assumption that best evidence of 
continued utility of a practice is results on own farm. This in most 
cases is highly visible and may be beet determined by the person using 
the practice. In education where results are not so readily visible 
and result feed-back is much more difficult, reinforcement of adoption 
decisions may be needed, 

]5i recommending research directed to community adoption patterns, 
Coughenour has suggested a number of distinctive features; namely, the 
origin, the slope, average diffusion rate, and the level at which 
adoptions level off or the equilibrium level, A variety of adoption 




patterns have smergsd in diffusion research findings with ^ some signifi- 
cant patterns if not trends. For exai! 5 )le, in education, innovations^ 
are sometimes accepted in incredibly short periods of time compared «c 
the past; also, an increasing number of adoption curves seem to show 
rapid acceleration almost from the start;9»11 ,50 thus quite devoid o_ 
the slow initial start of those frequently seen in the past. This may ^ 
suggest legitimation by dirsct means rather than by associates fortifiea 
by local trial or it may indicate rapid acceleration of personal inter- 
action from the start, or the manner in which school S 3 rs terns and ad- 
ministrators are enlisted in the adoption processes as Wayland has 
suggested.7^i50 Ih any case it would be particularly appropriate to 
detezmine the conditions and means of legitimation which result in 
these unique pattenis; also, other features and conditions which may 
explain early rapid acceleration. 

Diffusion research from a number of traditions suggests the high 
intensity interaction explanation.^-'*^6,59fl6 On the other hand, 

Lippitt in Mchigan found that some ^:eachers were reluctant to com- 
municate information about own innovative efforts to others, at the 
same time implying that they thought administrators expected them to 
be their own innovators and that they consequently would lose status 
by borrowing ideas from others. Should this prove to be generally 
true, it would impose serious restrictions on any multiplying effect 
that personal Interaction might have on adoptions Mort has also 
voiced a belief that lack of communicative exchange with change agents 
and peers may be an important factor in retarding adoption of in- 
novations in education. 53 Idppitt also suggests that differential 
role perceptions of teachers and administrators as to whom should be 
innovators and for vxhat in education may also be a deterrent; thus the 
need for role studies.- 

5. Change agent studies. 3h one sense, studies relating to 
change agents and their roles in the information innovation dis- 
seminating processes is not applicable to education because such are 
not an institutionalized part of educational systems. But in another 
sense they are because whether formally provided or not, inter- 
mediaries tend to develop between research sources and target audiences. 
Several studies show that persons occupying intermediate change agent 
positions between scientist and the information consuming public must 
work out effective ways of relating to both. 56, 19 

At least one study has shown that those who resolve conflicts 
deriving from the position in favor of the local clientele are most 
successful in achieving adoptions but can easily alienate themselves 
from important people in the central system, and in so doing bring un- 
desirable consequences to themselves. 19 Rogers has shown in Ohio that 
county agents get their information primarily from agricultural college 
related sources, 64 while Stone in Michigan study has demonstrated that 
county extension agents spend most of their time in rendering services 
to their adopter clienteles. 71 

6. The cownunity. Finally mention should bo made of studies 
which emphasize the importance of community factors, particularly the 
exercise of power ;»hich is likely to condition acceptance of 




Innovations* Quite aside f?Oi& whut every teacher and adinlnistrator 
knows about this fundamental fact, l*!ort and Cornell found that com- 
munity factors were second only to expenditure per pupil as a con- 
ditioning factor in influencing the quality and rate at which changes 
in education were accepted, 5^ At the same time, it has been found 
that changes were fflore readily accepted in relatively heterogeneous 
than homogenenous conmunitieB, 

Certainly for some educational innovations involvement and sup- 
port of people at the local community level is necessary# Whether the 
change targets are patrons, teachers, or administrators, involvement 
of them in the decision and planning processes makes them more receptive 
to and supportive of the changes being proposed,‘12,78 

Also, Involvement should be done in the light of the existing 
power structure of the community as Wayland, Bohlen, and others have 
stressed#75$2,3 Both have offered suggestions for doing this while at 
the same time avoiding such common mistakes as assuming that high in- 
fluence persons who occupy positions in formal organizations are 
persons of high power and influence and that they are always opposed 
to change# 

These are a few findings, speculations, and possible inq;>lications 
of diffusion research in agriculture to impl<»'" 4 snted change in education# 




"Reaction to Dr* Idonberger*s Presentation" 
by Dr. R. M. Worthington* 

My congratulations to Professor Lionberger for a very scholarly 
presentation and also for his development of a specialty in the field 
of diffusion research* Too few educators can claim a research 
specialty of any kind* particularly vocational educators. There is 
such a shortage of competent researchers in Vocational Education 
throughout the nation that it is extremely doubtful if more than a 
handful could claim any research specialty. 

The purpose of dissemination of research is obviously to put 
results into practice. The classroom teacher must be the instrument 
of change. He must put the results of research into practice. The 
administrator as the authority figure makes change possible. Change 
agents must be drawn from all levels of Voca’U.onal Education, Change 
must be affected cooperatively. 

Dr. Lionberger. it is difficult to compare farm practice to edu- 
cational practice; however, admittedly there are some parallels, I 
can recall my own experience, for exas^le, as a youth on the farm 200 
miles south of here in the Ken'tucky burley tobacco country where in 
1935# as a farm boy, I raised a one-acre crop of burley tobacco, % 
yield per acre was 1000 lb. and the price per lb, averaged 12^, In 
1965 the same acre of tobacco would yield 3000 lb. at an average 
selling price of 70^. 

Research conducted by the Agricultural Extension Service at the 
University of Kentucky has had a great deal to do with the increased 
yield per acre. Of course, many other factors are involved in tobacco 
prices today, I use this as an example to point out that I recognize 
the outstanding contribition the Agricultural Extension Service has 
made to agriciilture. However, it must be en 5 )hasized that in education 
we deal with human beings—with children— with youth— with adults. We 
do not deal with the impersonal farm problems such as better hybrid 
seed com, more yield per acre or leaner pork bellies. The agri- 
culture researcher has concentrated on benefits to farmers with 
emphasis on saving labor and money, making profits, and increasing 
benefits to farmers. Educational research must concern ijiself with 
the improvement of instruction! Unfortunately, in education, we have 
not yet found an effective way to award good teaching. 



’^Assistant Commissioner of Education, State Department of 
Education, Vocational Division, Trenton, New Jersey 




■'Je have the experdence and the ability in educational circle to 
do an effective job in research, However, we do not as j^et have the 
administrative structure and the necessary financing to carry it out 
effectively. 



I agree with Professor Lionberger that we need to develop a 
diffusion system aiid I would put it this way; we need a diffusion 
system and a set of legitimation devices particular to the needs of 
Vocational-Technical Education, No doubt the Ohio State University 
Vocational Research Center and ttie 24 state research coordinating 
units are a start in this direction. Not only can these research 
coordinating units be innovators but also legitimators. Professor 
Idonberger*s study of farmers in Northeast Missouri concerning dif- 
fusion of information in rural communities concluded that information 
"flows downhill in terms of prestige; the seekers seek information 
from those who have higher prestige ratings than either the seekers 
or the community average," As long as school systems recognize 
different prestige roles between teachers, supervisor;, principals, 
and other administrators parallel conclusions might be observed in 
flow of information throughout school systems. 

Prior to the passage of the Vocational Education Act of 1963# and 
the Elementary and Secondary Act of 1965» it was reported at a national 
research conference that 95'^ of the research funds made available 
through the United States Office of Education went to 10 major uni- 
versities, Very little of this research filtered down to the prac° 
titioner. Because practitioners have not participated in research 
generally their image of research has not been good« It has been 
looked upon as a "mysterious" activity and something beyond the 
capabilities of a classroom teacher or school administrator. Speak- 
ing of the image of Vocational Education, I might also interject the 
fact the only three states in the nation, at the present time, employ 
persons in their State Divisions of Vocational Education with full-time 
responsibility for public information. 

According to George C, Homan, "Research done in the last 20 years 
in the area of communications structure and influence flow has resulted 
in discarding the concepts of mass media and mass impact. The problems 
of civilization are the problems of the small gi'oup. Information is 
stepped down through groups leaders for attention , consumption and use 
by individuals in groups, " 

Neal E, Tiller, in the NEA Publication on Graphic Communications, 
poiiited out that in dissemination of research findings there must be 
established an "ilhnovator - Adopter Context, " In this respect he 
stated that Miler's "Drive, Cue, Response, Reward Paradigm" has 
implications for research diffusion. 



1 , Drive : 

2, Cue: 

3, Response : 

4, Reward : 



Adopter must want something. 

Adopter must notice something. 
Adopter must do something. 

Adopter must get something he wants. 
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Ku?t Leiiin, in the Journal of Social Issues, suggested that in 
order to get people to change we must move them through three behavioral 
steps, which he refers to as; 

1 , Unfreeze ; Change to improve or avoid worse condition, 

' Create dissatisfaction# 

2e Move: Inducement or reward# 

3# Refreeze ; Equilibrium set at nevr behavioral level# 

Art Gallaher, Jr# , of the University of Kentucky and also Egon 
Quba and David Clark of Ohio State University, have suggested that edu- 
cation might very well adapt the methods of the Agricultural Extension 
Service# 

Gallaher recommends the creation of an education extension 
service with functions of irjiovation, dissemination and integration# 

He asserts that the problems of educational change do not rest mainly 
with the administrator who is more often called upon to play the 
balancing role between school board, parents, teachers, students, and 
other administrators— than to provide the leadership for change!# 

This recommendation makes a lot of sense to me because the ad- 
ministrator must make it possible for the teacher to implement 
change! 

The teacher is the key to all our effort! Teachers of Vo- 
cational Education make or break the program! They must be involved 
in research if research is to change practice# I agree with Dr# 
Lionberger that ^Teachers may be reluctant to accept innovations 
regarded by them as artificial if they did not have a part in the 
innovating# " 

I'EA*s Association for CJurrfculum Development sa 3 rs that the action 
research idea has so much to commend it that we should strive for the 
time ■^ihen a part of each teacher*s day would be set aside for it as a 
part of their scheduled responsibility# Others particularly "Uni- 
versity type" researchers have taken a dim vievx of action research- 
calling it "nothing more than qualified common sense rather than re- 
search#" Action research is based on concrete practical problems 
in a real school situation# 

It seems to me that one of the best ways to disseminate research 
results is through action research# Action research has been defined 
by Stephen Corey as "research undertakon hy practitioners to improve 
their practices," By getting practitioners involved in research, 
evidence can be accumulated to define problems more sharply# The re- 
searcher can draw on experience available for action hypothesis 
enabling them to cope ^■lith day-to-day problems# Action research can 
test out promising procedures on-the-job and av’icumulate evidence 
immediately of their effectiveness# In action research factors being 
researched are studied as a part of the day-to-tiay activities and 
problems of the teacher# Action research studies problems and tests 
innovations 3n the classroom with the primary goal of improvement of 
ins true vicn# Outcomes of action research are based on behavioral 
changes that occur in the teacher-researcher themselves# Practice 
does not change unless the teacher himself changes# 





"Reaction to Dr, Lionberger's Presentation" 



by Dr, Alan G, Robertson 



* 



I think we have to differentiate in terras of diffusion— that 
which is content in vocational education and that which is methodology, 
I don*t think we can use the same practices and the same methods to 
diffuse change in content in our areas of vocational education as we 
can in methodology, I think methodology is a lot more difficult, I 
don*t think we can depend upon the illustrations of industrial prac- 
tices or farming practices or new concepts in women’s occupations to 
illustrate that content change is necessary and up-to-date. We can 
possibly show it by the changing job market, 

vrith regard to classroom methods and techniques or the use of 
equipment, you always come across the vocational education teacher 
who says, and perhaps correctly, that kids are kids and no matter 
what you do with them they’re the same, and, therefore, you may bend 
the methodology a bit but you teach the same, I think that in terms 
of diffusing new ideas in education we have a real problem in new 
techniques and methods, 

Di terms of adopting new ideas in an agricultural frame of 
reference, we are using cost analysis practices, primarily whether 
there is short-term gain or long-term gain and it’s sometimes pretty 
difficult to determine. Sometimes you have to do a follow-up study 
twenty years later to determine the effectiveness and value of an edu- 
cational change and the acceptance of that change. We don’t have that 
immediate return of results upon which we can evaluate new practices. 
In regard to any suggestion that maybe we should take research and 
development in vocational education and by-pass the school system— 
by-passing the vested interest, l^y-pass this resistance to change, 

I don’t think we can do it. If we try out new methods, try to adapt 
new techniques in a laboratory sense in a laboratory situation in a 
peripheral organisation, whether its foundation or an equipment 
supplies facilities— as soon as you try to put that back into the 
school siiTuation you’re dealing with the problem suggested by Dr. 
Worthington where people will say this is an artificial situation— 

"I wasn’t involved; it doesn’t fit local set of situations," You 
can’t by-pass the local situations even though it may be negative; 
instead, you have to anticipate it and account for it. Therefore, I 
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think we have to deal with the negative factors in change as much as 
we do with the positive factors, Ir» other words, let*s identify the 
barriers; let*s identify the blocks. If we anticipate then, they 
won’t trouble us quite as nsich when we come up against them in the 
diffusion of information. One of the blocks that I see is that we 
are dealing with a great moltiplicity of potential change agents, 
whether they’re the legitimizers , the communicators, the adapters, 
people on the local level. Let’s see if we can enumerate some of 
them and I think this enumeration will illustrate why our problem is 
so different. 

First of all, we have to reach the general public and get their 
acceptance of educational change, W© have school-connected public, 
school-connected business, government organizations, branches of the 
legislature, the executive in terms of the governor’s budget, the 
judicial in terms of cour decisions on things that we have been try- 
ing to do in education. We have local boards of education, county 
boards of education, state beards of education— all of which may 
have different ideas. We have manufacturers of school products, 
related practitioners, and professionals who have to be convinced, 
like lawyers, school public health officials, school architects, 
and you know what a problem that is in terms of new facilities, 
design and layout. We have all kinds of educational researchers 
that we have to see on change, too, both in the educational frame- 
work and in the social science framework. You deal with the pro- 
fessionals in education and here there are a whole gamut of different 
types— school teachers, school psychologists, pupil services, ad- 
ministrators, subject-matter supervisors, superintendents, college 
administrators, professors of education versus professors of content, 
and these two don’t match very well sometimes, state eduei*vion 
department and finally on top of the list we have the TJ, S, Office 
of Education, 3h trying to deal with all of these change agsnts in 
the complexity of public education, I think we have our work cut out 
for us. And, of course, the most important group, one not listed 
above, is the learners. We have the youth of different types as 
identified in Public Law 88-210: youth with special needs— again 
of many different kinds as we have recognized in our Trarious states 
^d, so, we have these potential barriers and this problem of try- 
ing to shift our approach in order to reach the right change 
receptor with the right change technique and instill the right 
attitudes. Some of those negative factors present are: 

1, How pertinent is the information to me, that’s one barrier, 

2, How authentic is this information which is being diffused? 

3* ^'Hio is the diffuser, a professor or a state education 

department bureaucrat? 

4, VJhat is the authority relationship of the diffuser? Is 
he my local principal— an "I do it because I have to" 
relationship? Is it a blanket order going out from the 
superintendent’s office of a large city that all-day 
classes in trade and machine shop, have to inclv\de 
these units and these practices? 








Is this research infoiraation coming dovm to me isolat.ed 
by itself or ara I getting several different slants all 
pointed toward the same over-all gcal; in other words, 
research information which converges from different 
sources and points up the same results very often has 
more status than something which is isolated by itself* 

It*s been said that research infomation just as re- 
search information is a pretty weak "shaper of edu- 
cational practices." 

More utilization barriers, barriers that operate at all the 
abc-ve levels and with all the types of people, include the following: 

1. ^'Ihat is the norm, what is the status quo? 

2. VHiat is going to try to counteract any change— the idea 
that for every action one way there is a reaction the 
other way— how do we identify this? 

3« The overload barrier, the pressure on people to do too 
many things, so therefore the change is put in the 
bottom drawer or maybe worked on only after school. 

4. ^'fhat is the stress involved in the change? Is it a 
happy type change or is it something that upsets 
people? 

5. Do I expect the costs of this change are going to 
outweigh the rei>xards? This can be a negative factor, 

6. Are there vevi&Tds not connected with the change— such 
as financial gain, loss of power or prestige? Is 
there any conflict of interest on the local or any 
of the levels? 

7. How does all this tie in with a research coordination 
staff operation? 

I think we have to look at some different tacks in terns of 
dissemination. We have to develop techniques in funding proposals 
with state money, l^aybe we ought to build into our budget something 
like a "field tester" when we are funding a local innovation, Let^s 
not cut it off with 225 copies of a written report into the state 
education deparbnent before we make the final payment. Instead, 
let*s build in maybe a month *s travel time and a substitute teacher *s 
time for the change innovator to first go on the road to other school 
systems to observe, talk, discuss, and to invite others back to see 
the change, I think we would get a lot more mileage out of our local 
4 a projects if we did a little more dissemination that wasn't written. 

In terms of the future, all the Research Coordination Units 
ought to concentrate on being quality control people— people who 
aren't hampered by federal report data in terms of their own operation, 
that have to get in by the first of July, that as quality control 
people xve develop \mys and means to deal with resistarice to change 
and resistance to evaluation and that most important, we start train- 
ing people in the field for research utilization. This in the long 
run may be our most important function. 



DISSEI^IINATION OF RESEARCH AND DEVELOPMENT INFORMATION 

by Harold Haswell’*' 



SRIC - The Program of The Educational Research ^formation Center 
U. S. Department of Health, Education and Welfare 
Office of Education, Bureau of Research 

eric’s purpose is to make available to the educational community the 
valuable research and related material which might otherwise remain 
unknown to it, 

I, ERIC « The General Need of the Education 

As in the science world, it is necessary that the educator have 
access to the work of others in his field. He cannot afford to isolate 
himself or his work from that being done by his colleagues all over 
the country, 

II» And the special need of the Office of Education 

3h addition to this general need, the Office of Education itself 
needs ERIC to help manage the great number of research projects the 
office itself supportvS, Since 195^ when the cooperative research act 
was passed, liie Office of Education outlay for research has increased 
from $1 million to $100 million, 

III, The two eric’s 

1, ERIC Central, which coordinates Lie national system, 

2, The ERIC system of decentralized research clearinghouses. 

This means that, unlike most information dissemination systems, not 
all education research documents or specialists will be housed under 
one roof. The documents and specialists are left where they are. 

Established collections of educational material are not dis- 
rupted; instead, they are built upon. Each clearinghouse specializes 
on a single research topic and seeks out the literature in the area 
of its special V, Clearinghouse specialists identify, acquire, and 
select materials to be forwarded to ERIC Central, 



Director, Educational Research Information Center (ERIC), U, S, 
Office of Education, Washington, D,C, 

Note ; This presentation focused upon a nmber of overhea«v '•'isuals »'>• 
hence the outline form has uc»en used to show the primary content of the 
visuals. 
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Accepted dociunents are abstracted into 250 words and indexed# 

Those forwarded to ERIC Central are reviewed there, and if satisfactory, 
go into the national distrifeation network* 

Locuments are indexed by a system developed cy ERIC Central-- 
an important by-product of this system will bs a thesaurus containing 
several thousand education terms. 

The abstract and indexing are combined on a resume form. This 
becomes the basic description of the document and is copied on micro- 
fiche# Microfiche is a 4 x 6 inch sheet of film carrying five rows of 
12 images for use in inexpensive miciofich readers. The 50 pages of 
document No, ED001631, for example, is reporduced on one microfiche. 

Documents are now retrieved by use of coincidence cards, A 
search for material on "curriculum" will produce a large number of 
documents# Superimposing qualifications— "curriculum in poverty area 
junior high schools in New York State," for example— will produce fewer 
more specific papers. As the system grows, a computer will be used. 

Stored documents are .announced pi bulletins. Author, title, 
location of study, length, and a resume are listed. Requests are 
filled by reproduction on microfiche at a few cents a copy. Hard 
copies cost a little more, 

17. ERIC»s Initial Effort 

To supply documents on educating disadvantaged children. Nearly 
1 ,800 documents were selected and disseminated. Four packets of . 
material were mailed to 650 state and local education departments. 

These packets totaled: 

1,750,000 resume forms 

2,400 program descriptions 

560,000 microfiche, representing nearly 30: million printed pages 

Now the task of ERIC is to develop the decentralized information 
system, coordinating input from clearinghouses with needs of users, 

V, ERICAS Ultimate Goal 

A networic that will link universities, professional organizations, 
school systems, boards of education— the entire educational com- 
munity— to speed all research results to places where they are needed 
and when they are needed. 



APPLICi\TIO^^ OP PERT TO EDOCATM 



by Desmond L. 
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The title of this address is "Applications of PE^ to Education, " 
Perhaps it would be better to ask the questions Can or should the 
management information system known as PERT be applied tj educational 
activities particularly research and development projects? An answer 
to this question lies in understanding three things. First » the 
purpose and nature of management,. Second, the context within which 
PERT developed. Third, the similarity of the educational to the non- 
educational enterprise where PERT is used- I would like to discus® 
briefly e »ch of these points, make on or .two general comments on 
reasons for applyang PERT to education, and then give you some cf hqt 
thoughts for the future, 

Ifanagement Process. The managoaent process can be broken down 
into four or five steps depe.uding cn how you want to consolidate terms. 
The first of these is establishing the end objective of a XJarticular 
project or program, *The more clearly we identify the goal to be 
reached, the more likely is the project to be successful. After the 
final objective is identified, then we must plan and outline the work 
to be done to reach the goal. For any particular project, there are 
many plans one can follow to reach the goal. Eventually, one plan is 
established to start, Mter the plan is established the process of 
scheduling is began. Scheduling permits us to begin organizing 
personnel, materials, and related items to accomplish the plan. 

As the project moves along, progress is measured to note devia- 
tions from the plan. The project may be behind, ahead, or on schedule. 
Hopefully we will at least be on schedule, 3h ttose cases where the 
project is behind, schedule, then some replanning must be done. The re- 
planning process not only involves changing the plan, but it also might 
cause us to establish new objecttves or even to modify the original 
objectives. 

To summarize the process of management, I would stress the two 
tasks of plaiming and controlling. Fianning is outlining the work 
while controlling is noting deviation from, the plan and making 
necessary corrections. 



^Professor of Educationf, The Ohio State University, Columbus, 



Ohio. 



If one examines many educational research and development 
activities » he will note that the several management steps are in- 
volved in the conducting of the work. The pro, jest director, there- 
fore, becomes in effect a manager who makes decisions centering around 
•the most optimal use of time and resources to achieve the projective 
objective. 

PERT Devalonment. Now let us look at the reasons for the 
development of PERI. The traditional and existing management systems 
appear to have not been adequate to do the job of planning and con- 
trolling in a new area— that of research and development. If the 
concem is with production or routine activities, the present systems 
prove quite adequate. But when we move into new araas such as those 
represented high state-of-the-art Involved in the research and 
development areas, there appears to be a need for a different system. 
Further, the magnitude of many military research and development pro- 
jects put a tremendous stress on the coordination of the work of many 
subcontractors* These two conditions of inadequacy of traditional 
management systems rmd the magnitude of the research and development 
projects led primarily to the development of PERT, A secondary .con- 
dition which facilitated ?ERT*s development wavS the availability of 
high speed conputers. If such equipment to provide infonaation 
quickly and rapid3.y as demanded had not been available PERT might not 
have been so successful as it turned out to be* 

Educational Research and Develonment Characteristics. Let us 
move now to the similarities between educational and neneducational 
research and development situations. First, let’s look briefly at 
the characteristics of research and developmei^it projects and ask the 
question: Does the characteristic fit the industrial and militaiy 
situation and does it also fit the educational situation? 

The first characteristic of research and development projects 
is the fact that the end products are either single or few in number. 
It may be that xto are producing a n&tf curriculum which may consist of 
a teacher’s guide and a svudent textbook. We have now two end items 
making up a total project. We may have on the other hand one product, 
such as the development of a new student registration system. Just as 
we had the development of a Polaris submarane system as a product, we 
also have the development of a registration system as a product, 

A second characteristic is that to accomplish these end items, 
end products, or end objectives, the work to be done has to be ordered 
in terms of its sequence and dependency. One has to identify the many 
kinds of activities involved in ostalblishing a new registration pro- 
cedure or developing a new curriculum and determine their sequence 
and dependency. 

A thii'd "jharacteristic is the degree of uncertainty existing as 
to both the nature of the activities we are going to undertake and 
the time involved to do them. This is truo not only in the develop- 
ment of such items as rockets, missies, and even apace shots but also 
it is true in the case of trying to develop both an achievement test 
which will have validity for a new cuj.'ricidum and the evaluation of 
that particular curriculum. 
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Fourth, nost research and development projects can be charac- 
terized as being ”once-through” activities. The project is done only 
once. Once it is done, the chances are that nobody else will do it 
again* This condition has raised, by the way, an interesting question 
with regard to evaluating applications of PERT to projects. Someone 
has suggested that the way to conduct such an evaluation would be to 
come out with a statistical test of significant differences (by com- 
paring one or some criteria) between a research and development ' 
project using PERT and one not using PERT. If one keeps in mind the 
concept of ”once-through" plus the nature of researc'' and development, 
how can you have two identical projects unless you purposely want to 
fund two for this purpose? Hence, the evaluation of PERT as a tech- 
nique is going to be for some time somewhat on a subjective or non- 
statistical test basis. 

Fifth, research and development projects require the co- 
ordination of many persons and agencies. I would just have you think 
of all the people who have been involved in preparing and conducting 
this workshop. The staff had to arrange for the physical facilities, 
•eakers, assemble teaching aids, contact the publicity office, and 
jiy other activities. You can just imagine what it would be when 
dealing wii^ a project such as Apollo or Polaris. One problem is to 
have some systematic way of communicating to the several agencies, 
the staff, and the other people what the project is all about, the 
flow of the work, the nature of the work, etc. 

Looking at these five characteristics very quickly, one can apply 
them to a project like Polaris and then go from there and apply them 
to educational research and development. I think you will find they 
fit bcth situations, !5i ny thinking about PERT*s possible application 
to education, I start with the assumption that the characteristics of 
educational research and development projects are basically the same 
as the characteristics of research and development projects in govern- 
ment and industry. 

Current Situation r Now let me comment briefly upon- what I 
believe to fee some current courses or factors operating in education 
which cause us to look at management information systems as a way of 
helping us do a better job in the research and development effort*, 

I think we are now entering a phase that industry and govern- 
ment entered years ago; that is, finding a new way to manage the re- 
search and development enterprise whai traditional methods might no . 
longer work. Both the government and industry were forced to pay 
attention to this problem. So must wel I don*t think we have yet 
been forced to face this issue, I do believe that we are going to 
have to face it whether we want to or not, t*Jhy do I say this? 
Primarily because we are now receiving research support on a scale 
or a magnitude that most of us probably never dreamed would exist in 
the field of education. The Cooperative Research Program started in 
195^ followed by the^NDEA in 1958* the Vocational and Technical Edu- 
cation Act in 1963, ahd the Elementary and Secondary School Act in 

1965. :• 



J 




Idok at all the programs we now havel look at all of the money 
we now have available to us I I don*t think we have yet the experience 
or the know-how to really manage this tremendous amount of money, 

We*re going to have to look at management systems to see if they can*t 
help us do a better job. Our effort with PERT is really just a little 
one compared to what I think will become a total field before long, 

I would advanvce as another reason why we have to face up to this 
problem is that our research and development projects are becoming 
more and more coraplffic. You have now project teams with up to twenty- 
five people. They are all doing many kinds of things snd may oven be 
in different parts of the country. One project, for example, involves 
not only Ohio State University but also The University of Illinois and 
Cincinnati Public Schools, So you know that there is a tremendously 
large group of people on this project, We are now going after our 
problem more and more with a team approach. This condition forces the 
project director to become a manager as well as a doer of research. 

The fact is that he may do very little research. All he does is hire 
and fire and answer questions and make decisions, and all those aspects 
which come with the mai^agerial position. You may say, *Well, you could 
tum these over to his assistant, " but when you have the responsi- 
bilities that come with the spending of funds, you want to take a hand 
in what you are doing. 

Another reason that I believe we have to look at the problem of 
research and development management in the field of education is that 
we are going through a time when innovation and change are being 
scheduled. We just can*t wait any longer :ln many areas for things to 
come about ly a process of osmosis or gradual transition, Ue are now 
deliberately sitting dovna and saying to ourselves in many areas of the 
educational world, ”Now look, we want a new curriculum a year from now; 
in this field. Let*s get at it. Let’s st^art developing it," Or the 
school board may say, "Starting September .1 , 1966, we are going to 
iii5>lenent Sl’SG, let us gat organized to do so • " These are the kinds 
of things we are now doing. The Board of Regents in Ohio plans to 
open a Cleveland State University within a year or two. Hers is 
something brand new, ^-niat are all the steps involved? Row do you 
handle it? Th-ase are the kinds of things I feel we are now faced wit?i 
in this areas of innovation and change, 

I think OTcept for what might be called the profit motive, our - 
concerns are very much like industry’s. We want a kind of economic 
efficiency. ^'Jhat is- the most efficient or wise use of a faculty 
member’s time on the project? To what should he pay attention and 
what should he not? We don’t want him to spend' all of his life an 
the project nor all of his wak?,ng hours on the project. We want good 
planning on educational projects. We waiit them to be -more realistic 
in terms of the time and resources needed, and more carefully explicated 
in the terms of the operational steps that one will have to go through, 
3h this way, we can better evaluate and fund those projects which per- 
haps seem most economically efficient in all aspects. 
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I think w'e are also faced the same as industry is with the 
problem of decision making. There is a great emphasis on decision 
theory as some of you may know, but we are getting closer and closer 
to the. problem. With many alternatives being available to us, which 
one are we going to decide upon? What is the best choice with regard 
to time and cost? These decisions keep occurring throughout the dura- 
tion of the project. All you have to do is manager or direct one for 
a while .and you vjdll soon find out that time-cost trade-offs occur 
frequently. In summary, I am suggesting we dnn*t have the experience 
yet in the management area to do adequately the job of managing the 
tremendous amount of money given to us in research and development 
efforts and we are obliged to do something about it. 

Educational Applications, Turning quickly to some current PERT 
applications In education, I would like to start by raising a question, 
I'/hen or under what conditions should I Implement PER'f on my project? 

If you meet three conditions, then you probably have a project on which 
PERT could be applied, Firstj is there a schedule to be met? Has 
somebody given a date by which something must be done? Second, is the 
project relatively conplex? Does it Involve many types of jobs, many 
types of persons, many types of activities or is it a simple linear 
three or four* activity task in its basic conceptualization? Third, 
how much uncertainty exists within the nature of the tasks and the 
timetable? If one can answer ’*y 0 s” to these three questions, I would 
say that yoYi have a situation to which you could apply PERT, In almost 
all cases, this covers the research and development projects being 
funded hy various kinds of agencies. 

We have encountered many applications to education. Let me 
present two or three. One is an application of PERT to the develop- 
ment of Cuyahoga Community College, a junior college in the Cleveland 
area, hy I)r» Ellis Benson, Dean Benson has a staff that meets weekly. 
Their activity and direction is determined by the PERT output which 
they obta.in almost weekly. With what kind of a task are they faced? 
This two-year community college started with about 6,000 students. 
Within another year they expect an enrollment of 14,000. students. 

They also have the land in an urban renewal area on which to build 
new buiic^dngs. They have to coordinate the building, the staff, the 
curriculr.n, and all other activities. We have also found that the 
Shoreline labile School District of Seattle, Washington, is using 
PERT in three situations. First, it is being used in the plamiing 
and establishing of a junior college. Second, it is being used in 
the development of a basic curriculum guide at the elementary and 
secondary level. Third, it is being used In the installation of IM 
260 series for this school district, Michigan State University has 
used a PERT network flow chart to move the library from an old build- 
ing into a new one. We actually have a chart in our office for this 
move. 



It dossn*t take one too long to really think of the many kinds 
of educational problems to which PERT can be applied. For example. 
The Ohio State University is going to a GE 636 conq)uter within a year 
or two, ^Hiat are the steps to be involved in making the transition 
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from our present IHI 7094 system? I think PEI^T could be used on this. 

We are also developing plans to schedule students by computer. X 
think PERT could be used on the development of this project* 

I would not be doing my job if I put any restrictions on the types 
of projects to which PERT could be applied. I think we have yet to find 
out. 1 don*t think we have looked at- this problem long, s^jough in the 
field of education to say that PERT could be applied here and can t 
be applied there. I think it*s still an open question. 

I would also be amiss in my duty if I failed to point out that 
everybody is not as enthusiastic about PERI‘ as I am. Many of my 
colleagues say that such applications are a bunch of nonsense. They 
state that once you begin to plan and control through such techniques* 
you begin -fco Impinge a little bit on their academic freedom. lou begin 
to force them into a kind of channel in which they don*t want to go* 

It doesn*t provide them with the opportunity to follow-up the opportu- 
nities they would like. VJe have also encountered a kind of resistance 
which I don®t know how to describe adequately except to note that when 
you get people PERTing and they have to define activities in order to 
set up activity times* they are now forced to define the activity and 
many times- they cannot do so. Such .a situation becomes a little bit 
embarrassing to them. 

Another prime objection is that PERT is fine for development 
projects and applied research but it just won*t do for basic research. 

I would ask such persons to read an article' from Harvard _ Business 
Review called “Pundamental Research Can bo Planned.”^ The writer was 
using netwoik theory in answering this objection by the Insertion of 
decision points. !Di any kind of basic research, such a procedure 
would be involved. It is simply a matter of replannirig after certain 
decision points are reached. 

A management information system like PERT does not plan or 
control in and of itself. It only helps us to do these two jobs 
better. One of the observations the PERT staff has made in working 
with people on education projects* and talking with people around the 
country* is that when you mention the words planning and controlling, 
they begin to feel that the PERT technique is going to tell them what 
to do; that it will for them and it will control them. This is 
just not the case! %e person who wants to use PERT is the person 
who makes out the plan. PERT doesn^t set the plan for him. He will 
also do his own controlling, PERT will only give him certain types 
of information that management specialists think are needed in order 
to help make sound decisions and actions as the project moves along 
toward the end objectives. 



^Robert M. Cavanaugh iind James 3, Quinn, ‘T^ndamental Research 
Can be Planned,” Harvard Business Review, January-February, 1964, 
pp. 111-124. 



Ftitayf> Concei3is« about soffis forecasts and iniplicauiv^s ^or 

the future? ^-Jhat do I see? I think you will find PERT applied ln» 
oreaslngly both in the planning and controlling not only of educational 
research and development but also in other educational activities* Once 
administrators can begin to see the value of the technique they might 
want to teach their students about it as a way of getting project 
objectives accomplished* T'Jhen we begin to get this kind of emphasise 
this kind of interest, I think we will then begin to get this kind of 
usage of PERT which we need to study its value* People keep asking us, 
^Because you are studying PERT under funds from the Office of Education, 
are they going to make us riSRT?” I cannot answer that question, but it 
is an interesting one as to whether or not it might help in the long 
run in securing better project management, 

I think in the future we are not only going to have to have stu- 
dents who study research methods but who will also study the msinagement 
of research and development. Research is getting too large to leave 
its administration to chance, We might well turn out at the doctor 
level research administrators and managers who are trained to handle 
the trmendous amount of money that we are going to receive for large 
team operations, 

I think another condition here which is important to look at is 
that if we faili to produce results under the varied and numerous govern- 
ment programs because we don’t know how to manage, to direct, or to 
administer projects then I think we are going to be hurting five or 
ten years from now. People will begin to evaluate us and our capa- 
bilities, They might say, ”We gave you all that money and you appeared 
to use it unwisely and, therefore, if you can’t handle it, why give it 
to you?” I think we are sort of obligated here to prove to people that 
we can handle the public’s money efficiently. 

Conclusion * A significant ojjportunity lies ahead of us to handle 
the increased research and development effort in a new way. Let us 
give attention to associated management problems in all their dimen- 
sions* Let us utilize PERT not from the traditional approach which 
generally imitates a new and respected technology coming in by a 
process of osmosis, but by a direct and ivnmediate application to the 
field of educatiouv 



basic annotated PERT bibliography is included in 
the Appendix^/ 





RESEARCH C00RD2NATI0H— t-HIAT LIES AHEAD 
by David L, Euslmcll 

In its year aiid a half, of activities# the Division of Adult and 
Vocational Research has had over 600 proposals reviewed and fonded 
approximately one-third of these proposals. A good deal of our 
success, I think, is due to your (Research Coordinating Unit per- 
so nel) functioning and your assumption of responsibilities last June, 
We^ve been weighing very carefully the goals and scope of operation of 
the Research Coordinating Units. Through several discussions with our 
advisory committees. Dr, John Bean and I have tried to identify what 
we think to be some of the major activities, the kinds of thrusts that 
you should be getting into in your state programs. Let me just go 
through and provide a checklist of items that you may want to con- 
sider as appropriate, and here I shall lean heavily upon the original 
purposes and objectives laid down in our call for proposals last May, 
We listed some eight areas. What I plan to do is go through this list 
and pinpoint some of the activities that appear most relevant for the 
states to be involved in. In many cases these are projects or 
activities already underway. The first area and a ‘very important one, 
of course, iss 

I, To stimulate and encourage occupational research activities. 

Without your communicating with relevant research groups in the 
state— the needs, the priorities, the objectives of our research pro- 
gram will not likely get the response they should. This means that 
we want to keep you advised on what research we have and you ought to 
keep us advised on your problems and interests and together wo can 
work out a set of objectives, assuming the best utilization of the 
funds available, I think this also suggests that you will want to 
keep abreast of the literature in the field as best that you can. 
Think jrou will also want to ke©p up on new legislation being passed 
by Congress, Some. of you may not know that in the Elementary and 
Secondary School Act, under Title V, there are monies available for 
summer institutes, summer regional institutes, that there are monies 
available under P.L, 480 for studies abroad, matching funds available 




r 



3|C 

Director, Division of Adult and Vocational Research, U, S, 

Office of Education, 

Nate ; This is not the coir^lste text of Mr, Bushnell*s presenta- 
tion, A "brief initial portion focused upon a set of visuals presenting 
a review of research funding activities by the Division of Adult and 
Vocational Research, 
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in foreign countries for study abroad. That under the OBO program, 
you can have access to basic adult literacy training— a fund to help 
set up and Implement basic adult literacy programs within the state. 

3h addition, the National Pefense Education Act has provisions 
for summer institutes as well. There are a whole host of legislative 
enactments which you ought to be attentive to so that you can adyise 
personnel in your state how to go about getting such funds. This 
suggests that you also know where to go for such funding. I recognize 
that there is a maze in Washington and you may have to spend some of 
your time actually coming there, walking the streets and corridors 
trying to find out who are the right people to see. We will try as 
best we can to conariunicate to you any changes that take place in 
organizational structure. 

II. The second ..lajor responsibility of the Research Coordinating 

Units is : To coord.inate research inside and outside the state . 

5y that, I mean to circulate listings of on-going research 
projects which vre provide and which you yourself may want to provide 
within the state. As a part of your activities, it would be useful 
to keep a listing of consultants within and outside the state who 
would be helpful to those wanting to conduct research studies, 
particularly at the local school district level. There they need to 
tum to someone to get the names of competent people who can be of 
help as consultants in structuring research or advising on on-going 
research. In regard to this function, it may be advisable to conduct 
periodic confo3:ences. In Phoenix there was a regional conference by 
several states who came together to talk about state-wide planning 
for in^lementing state research coordinating units and the use of 
vocational education research funds. 

III. To disseminate research information and findings as they become 
available. 

We feel that it is of great in^jortance to establish infoimation 
centers on the great deal of materials— textbooks, films, tapes, 
video-tapes, other instructional materials you ought to have there 
for use by the local school districts. 

IV, To review monetary and perhaps fundings research pro jects within 
your states. 

Here we are completely dependent on you fcr your assistance, 

V7e do not have sufficient staff within the Office of Education to meet 
the demands for the many consultative services or dj;aft proposals that 
come in. We have, we hope, been turning these people *s attention to 
the RCU*s in their state, asking for their assistance and thereby 
assuring a better quality of proposal before it comes to the Office 
of Education, We think this is a much more relevant and efficient 
way of handling draft proposals. We think too that there ought to be 
sources of funds within the state for research activities to meet 
state needs. Here of course we have 4 a funds under the Vocational 



Education Act as well a? funds becoming available under Titles I| III* 
and V of the Elementary and Secondary School Acts. These funds could 
and should be spent in resolving problems unique to your state efforts. 
They might also be used to support pilot programs, planning projects, 
demonstration projects, etc., that could be built into a larger study; 
a larger proposal to be submitted for federal support. This suggests 
that you may want to take some time in thinking about your own set of 
priorities hopefully gearing them to the priorities we have established 
at the federal level, 

V, To encourage and support pre»service and in-service training for 
research personnel in the state. 

There is going to he and is nt<w a definite shortage of qualified 
personnel, Ue think that the RCD'^s could be very helpful in support- 
ing and identif^-ing and in helping to locate competent researtsh talent 
within the state, 

There are Title IV monies under the Elementary and Secondary 
School Act for the purpose of tra:lning research personnel, We think 
that you people might very well work with your universities, and even 
yourself, in submitting a proposal for the conduct of nsvj research 
training efforts. These proposals should be subnitted to the Office 
of Education for funding. There is approximately 8 million dollars 
set aside for the training of research personnel at the post-graduate 
and under-graduate levels, 

VI, Another interest you might have is that of maintaining an active 
list of vZraduate students and nost-graduate students in the 
research field , "" 

There are many universities trying to find such people. We, 
ourselves, would like very much to tap talented young people coming 
out of our universities and training programs. 

Identifying and maintaining inventories of available occupational 
research and development resources— who in your state is capable of 
conducting good professional research in support of the vocational 
education field? You may want to conduct or contract for your own 
survey of your state resources for research, 

VII, Another function, and one that we think is extremely iti5)ortant, 
and one that began receiving a great deal of attention because of the 
Research Coordinating Units now in existence is that of planning. A 
good deal of effort has been made to survey available data on employ- 
ment opportunities, to identify the emerging occupational trends 
within the state and local regions, to work closely with the Bureaus 
of Bs5)ioymen'’ Securities in your state departments and to assist in 
the translation of this available information into skill requirements 
and appropriate traiiiing programs. 

We made a study, a non-random sample, of six state RCU*s: 
niino’^s, Mchigan, Nebraska, Kentucky, New York, and Iowa, and asked 
them to what extent they were able to coordinate with and cooperate 




with their state departments of euqaloyaent security? All replies 
indicated that there was interest in developing a more unified co- 
operative program of job information and there were varying degrees 
of progress. I can*t lend enough support to these kinds of co- 
ordinating activities to inclement the kind of training needed for 
our emerging technology. I*m not necessarily suggesting that the 
RC0*s become full-time research unenqployment agencies— it should be 
your goal as catalyst in getting the right groups together, making 
sure the planning is carried out. That the information now available 
at either the federal level or that available through the Bireau of 
Labor Statistics or elsewhere is translated into terms that can be 
used by vocational educators in planning their local programs. 

Vm. I think that you liave a responsibility in helping your_state 
directors develop the state plan for vocational education. 

You should be involved in assessing the adequacy of facilities, 
teacher training programs, recruitment, availability of new and tra- 
ditional trai’^'^ng (as against the demand for such training). This 
ought to be yi r role as a chief planning agency for the state 
department of vocational education. T-Je think too that in this role 
of planning that you ought to be able to relate the vocational edu- 
cation needs and interests to the broader state educational program. 

VThat role should occupational education be playing in preparing 
the disadvantaged youth for not only a vocation, but for their role as 
adult citizens? I think it*s time that you begin vocational education 
in general, begin taking the initiative of preparing youth for suc- 
cessful careers as adults in sub-professional occupation. 

IX. Kbving on to the next major area of emphasis , I want you to ke_ep_ 
abreast of the kinds of funding the federal government is making 
availai^e so that you will take the initiative at the state depart- 
ment of education level in seeing to it that these funds are put to 
good use. With vastly increased state aid, with the rising prestige 
of vocational and technical education, with the ties that vocational 
education has had traditionally with industry, and with the snow- 
balling support of community colleges and area vocational schools, 
we think there is going to be a definite coordinating function that 
the RCU*s could play at the state level. If you are doing this job 
properly, you will be look ahead five cr six years; you will be aware 
of the increasing demand for college attendance; and as students will 
not be able to get into a college of their choice, technical in- 
stitutes, or any college for that matter, they*re going to fall back 
on their community colleges. This rise in demand will certainly 
benefit and should be planned for in implementing proper vocational 
and technical education programs. 

Vfiiat are we planning to do at the federal level in support of 
Research Coordinating Units? I must say that it*s been an exciting 
year, things have happened that we hadn't even dreamed would happen, 
and many of you have shown tremendous initiative in seeing that these 
changes were brought about. States like Connecticut and Oregon have 
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been very impressive in their finding of better occi^jational training 
to meet the kinds of needs that exist within their states; the effort 
Illinois has made in soliciting and supporting research on its own. 

In the states of Washington and Net? York, the RCU*s fit within the 
state department research program as a whole and as a result they 
have made considerable headway in allocating funds, bringing about a 
better means of studying needs in vocational education. 

We recogniae that a few of you who have had staffing diffivjulties 
and we* re iB^ressed--in spite of that problem— the speed of develop- 
ment and scope of your operation, I honestly believe th£.t the funds 
invested in the RCU*s will have a greater lii 5 )act on vocational edu- 
cation in the long run than a coiiqjarable amount spent to finance civic 
projects. There is no question whatsoever as to the value or desii'a- 
bility for continuing our RCU*s— the only question is one of finance, 

3h the long run, it is our view that the necessaiy exper.ve of inter- 
state or intra-state research coordination should be bo;rr.i> by the 
individual states— I think that was made clear in the establishment 
of this program that in the long run we hoped to be able to phase out 
federal support and see these state units become entirely self- 
sufficient, However, in the short-run it is probably unrealistic to 
expect that adequate state commitments could be made in time to 
insure the continuing functioning of all the RCU operations, Thei?e 
are several reasons for this-^e know that state departments and 
universities have already planned their 19^7 activities and budgets, 
and that the level of activity in the RCU is such that they cannot 
expect to find sufficient state funds to carry those programs out. 

We know that in some states the ancillary 4a aid funds would bo a 
logical resource to turn to. but they*re, in many cases, not adequate 
to meet the demands. In North Dakota, for example, a commitment of 
the total 4a funds would cover only one-third of iiieir RCU costs; 
thus time must be allowed for finding other sources of support. We 
know, too, that legislation will be required in many states if sub- 
stantial expenditures are to be made for vocational research. Most 
of these state legislatures meet on a bi-annual basis and, there- 
fore, could not possibly get together before 1967 * Ih light of these 
facts, I am recommending to the Office of Education that they author- 
ize and negotiate amendments to the existing RCU contracts to continue 
their operation for an additional 18 months, beyond next November, 
Beynnd that, hoviever, we hope that there will be a phasing-out of 
our support and that there will be evidence of a continuing talce- 
over of these xmits by the states. There are a couple of conditions 
that we*ve built into this possibility of re-funding and additional 
funding. 

The first is that we are going to escalate the matching fund 
requirement from 10*^, which we began with, to 15^^ as a miniraum, 
realizing that many states can go well beyond that level. We*re 
also interested in seeing that those states which have not received 
RCU*s get some consideration. For that purpose, we have decided to 
ask all states interested in submitting proposals to do so on or 
before June 15th, Then we will have a chance to review those and 
pick the best from among them. It does not mean that we will fund 
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all. pr*.vpoaals submitted. are ear-marking about 2 Billion dollars of 
om' 1967 fiscal year funds in .suppor: of RCO’s. This marjas that on 
the average, we can only support 20 aiiitioi'.al un?.ts* Bay also, and 
1 want to Bake this quite clear* decide to Giscontinue support of some 
already existing RCU*s where they have not been able to fulfill their 
obligations. If there is evidence that they are not succeeding, there 
is no reason we should go on supporting then* instead, we should 
probably take this aoney and aaice it available to a state which now 
has or wants to establish an RCIJ prograa. We th^Jc we can see our 
way clear to continue support of Bost of tho RCU*s that are now In 
existence beyond Kc-vember for an additional 18 months. We are 
asking that there be a lainiraun of isatching 1 5^ teds available and 
that some of the larger more affluent states go well beyond that 
minimal level. We are going to entertain additional proposals before 
June 1 5th and out of those we will select additional units to support. 

X would like to close emphasizing ihat I think to be one of 
the most important missions in vocational education, as well as in 
general education today; a mission in which you can be a veiy great 
help in ingplementing. I think it is important to recast some of our 
basic attitudes toward vocational education and general education. 

We should not see it as an obstacle course which is deliberately 
designed to eliminate a certain percentage of the participants in 
this course. Hopefully, it*s rather a way to enrich the lives of all 
those who undertake to inqprove themselves in the game of education. 
There should be no losers»«only winners. To achieve this kind of ^ 
goal in our public education system, we have to gear our program in 
the largest percent possible to the individual needs of students and 
ways must be found to provide each student with the basic and occu- 
pational education at the time he will benefit from it most. In 
other words, we have to shift from being a ’*people oriented” edu- 
cation enclave to a “student oriented" effort. The failure of an 
individual to acquire the essentials of a basic and occupational 
education, I feel is not so much his failure as it is the failures 
of educators to devise an effective vocati.onal education system. 

How to inaugurate such a program is not only our greatest challenge 
today, but yours as well. 
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APPEl'iDn A 



Functions and Definitions of Functions of a Research 
Proposal or Research Report 

by David L« Clark, Egon G. Guba,* Gerald R, Smith 



PR0BLB>f; 

A« Establis?ilng — to establish the existence of a situation (e.g., 
^ anomaly, a series of contradictoiy “facts," unverified find- 
ings, or an uncharted area) which suggests a problem. 

B. Relating to relate the problem to its general antecedents 

(©•g*8 educational, scientific, societal, etc.), 

C. Qualifying — to qualify the problem in terms of the special 

conditions which tend to modify, restricts or limit its study. 

D. Justif:^dng to justify the apparent utility, significance, or 

interest inherent in the investigation of the problem. 



OBJECTIVES ! 

A. Proposing — to propose the definite goals or ends which the 

investigator intends to achieve as a result of conducting the 
research. 

B. Justifying — to justify the selection of the specific objectives 

chosen for study by naming the criteria employed in making the 
choice and showing how the objectives meet the criteria. 



lOGICAL STRTJCTURE OR THEORETICAL FRAMED RK: 

Ao founding; — to expound the structure or framework within which 
the situation will be investigated, that is: (1) in the case 

of the logical structure, to provide a rationale for the per- 
spective from which the investigator will examine the problem; 
or (2) in the case of the theoretical franewoz^ to conceptualise 
or state the theory in whose terms the investigator will ex- 
amine the problem. 



Reference was made to this outline in Dr, Cuba's presentation. 

Dr. Guba on behalf of the co-authors has granted permission for ite 
reproduction here. 

Note; Dr, Guba's presentation based in part on a paper. Tvnes of 
Educationa l, Research , is not presented in this report. The paper, in its 
entirety, will appear as part of a published volume by another publisher. 
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B, 



Validating ~ to validate the application of the partdcu7.ar logical 
structure or theoretical framework in. the investigation of the 
problem in tenns of its anticipated advantages and consequences. 



HYP0TK5SSS OZ OUSSTIONS i 

A. Prt^posing ~ to propose the specific questions which will be 

answered or the hypotheses which will be tested in the in- 
vestigation of the problem. 

B. V alidating — to validate the fact that the questions can bo 

inferred i*easonably or the hypotheses can be derived directly 
from the logical s?trueture or the theoretical framework. 



REIATED SCmCE. KtTQlJLEDGE. Mm PRACTICE; 

A. Describing — to describe the studies and the writings pertinent 

to the substantive and methodological aspects of the in- 
vestigation. 

B. C^tiqueiiig — to critique the identified, materials in terms of 

their strengths and weaknesses, as for example, limitations, 
validity, consistency. Inclusiveness, and heuristic value. 

C. Relating — to relate the identified materials to the investiga- 

tion by (a) showing how the methodology is based upon or differs 
from knovm design and measurement principles, and (b) placing 
the substantive aspects of the investigation in documented 
historical and scientific perspective. 



mERlMEHTAL msim OR gnTSSTIGAlDRY PLAN ; 

A. Outlining — to outline the over-all structure within which the 
investigation will be conducted including the variables which 
>7iU be considered, the conditions which will be controlled, 
tlia processes by which the data will be gathered, th© san 5 >le, 
and the sources of data« 

E. Detailing — to detail the design of the analytic procedures and 
the sarnie sufficiently to indicate that (a) the hypotheses are 
tested or the questions are answered unambiguously-«the con- 
dition of internal validity; and (b) the findings are 
generalizable to the population or circumstances required 
the hypotheses or questions being considered— the condition 
or external validity. 

Ouera'fcicnalls ’dng. «— to make operational the variables or conditions 
in tlie Investigation specifying the Instrumentation or the 
techniques of ijnstrumont development including the rationale 
supporting their selection or development. 
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D« Qualifying — to qualify the conclusions or generalisations irtiich 
can be draxm from the investigation in terms of any special 
conditions which are inherent in the ana1yt3.c procedures, 
investigatory plan, sas^le, or instrumentation* 



WORK SCHEDOIE AND HESOURCES ; 

A* Describing — to describe the time schedule on which the project 
work win proceed, the human and technical resources which will 
be devoted to the work, the physical arrangenwits which have 
been or 'trill be made to carry on the work (as, for eocanple, 
field arrangements for data gathering in school settings), 
and the fiscal requirements for “the conduct of the in- 
vestigation as described, 

B, Justifying — to justify the adequacy of the personnel and 

facilities to accoc^lish the described inves'tigation and the 
rationale underlying any special conditions or arrangements 
which are necessary. 



FmmGS ; 

A, Presenting — to present the data ac'fcually gathered in sufficient 

detail so that the reader can reconstruct the methodology of 
the research and assess the data gathered in relation to the 
plan of the investigation. At this point in the reporting 
process, the findings should be presented so that the actual 
data gathered are retained as fully as possible, 

B, Examining — 'bo examine the data completely in accordance with 

the analytic procedures which have been proposed, 

C, Summarii;;ing — 'to summarize iiie findings of the investigation so 

that all da'ba rela'ting to the hypotheses or questions are 
presented succinctly, accurately, and with proper qualifica- 
tions. 
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APPENDIX C 



A Basic Annotated PEPJT Bibliogx’aphy to Accon^jany 
Paper Presented by Dr. D. L, Cook 



Blood, J, W,, ed, PERT; A Hew IlanageRent Planning and Control TechniQue^ 
New York, American Management Association, 1962. (Gabriel 
Stilian and others.,) 

A collection of 15 readings dealing with the relationship 
between management and PERT. PERT theory, practical experiences 
with PERT, and PERT variations. 

Cook, Desmond L, An Introduction to PERT. Occasional Paper 64«>156. 
Columbus, Ohio, The Bureau of Educational Research and Service, 
The Ohio State University, 1964. 

An elementary discussion of the principles of PERT with 
particular reference to its use in educational research and 
development projects. 

Dean, K. L. Fundamentals of Network Plannl r g and A nalyeis. St, Paul, 
Hinnesota, liliitary Department, UMIVAC Divi£,ion of Speriy»Rand 
Corporation, January, 1962. (PX1842B) 

A general outline of the principles of network underlying 
boiii PERT and CPI! techniques. Special emphasis is given to the 
implementing of neb-iork techniques for persons unfamiliar with 
network planning and analysis, 

loacCrimmon, X, R, and C, A, I^avec, An Analytical Study of idle PERT 
Assuiap t ipns. Memorandum R14-3405-PR. Santa Monica^ Calif emla; 

The Rsind Corporation, December, 1962, 

Presents the results of a mathematical analysis of the basic 
assu^tions used in PERT calculations and direction and 
magnitude of errors introduced ly these assumptions both for 
individual activities and the total network, 

^lalcolm, D, G. , Roseboom, H. J, , and C. E, Clarlc. ^Application of 
a Technique for Research and Development Program Evaluation,” 
Q^^erations Research, v, 7:646-669, September-October, 1959, 

One of the first papers to appear on PERT. Describes the 
development of the model, the initial preliminary extended 
application to the POLARIS program, Basic assumptions and 
limitations are presented. 
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Hiller, Robert W., Schedule. Cost, end Profit Control With PERT. McGraw 
Hill Book CoB5)any, New York, I965. 

A conqprehensive presentation of the ojdgfcis of PERI; the 
problems and procedures Involved in Implementation; the relation 
of PERT to project definition, systems engineering, and con- 
figuration aanagemait; and the relation of PERT to management 
systems. Good discussion of network principles and const^ctdoi., 

Murray, John E, ^Consideration of PERT As8UB5>tions,” IEEE Transactions 
of the Professional Te chnical Group on Ehg ineering Manag ement. 

V, EJi 10, Number 3t September, 1963# — 

Analysis of the original PERT statistical assumptions in view 
of experience gained with the technique. Cites reasons for the 
establishment of original assuo^tions and suggests modifications 
designed to inqprove the statistical basis, 

Phillips, C, R, Computer Prog^^s for PERT and CPM. 2d, ed, rev. 
Technical Paper No, 13« Silver Springs, Maryland, Operations 
Research, Ihc,, October, 1963* 

Discusses the features of the various conqjuter programs 
developed for both CPM and PERT, Provides a listing and brief 
description of programs along with type of machine, resource 
to contact, etc, 

P5^ Fundamentals. Washington, D,C,f PERT Orientation and Training 
Center, Bolling Air Force Base, 196^, 

A thr?e volume series in programmed instruction format covering 
the networking (volume 1), scheduling and planning (volume 2), and 
workbook plus final examination (volume 3), 

PEOT,,, Guide. f or M?magem Washlngtcm, D.C., PERT coordinating 

Group, Office of the Secretj/.ry of Defense, 

Description of PERT fundamentals 110 as to provide for a common 
means of communication between militsir^, industrial, and eovem- 
mental users of the technique, 

PERT, Program Evaluation Research Summary Report, Phase 1 , 

Washington, D.C, , Special Projects Office, Bureau of Naval 
Weapons, Department of the Navy, July, 19^, 

Pwsents the first phase of the or:lginal developmo^nt of PERT 
and its theoretical potential for management as developed by the 
project team of Navy Special Projects Office, 'Booz, Allen, and 
Hamilton, and lockheed Missilo Systems Division, 



Tks Impossibie, Please 
—AND H5JRRT! 

fiSSEARCH shoved the way fcr modern invention and production, 
for conveniences and engineering marvels. It vas the making of great 
corporations. 

RE^ARCH brought disease under a degree of control and prolonged 
the span of life. 

RESEARCH put man into space. It will project him to the moon and 
the planets. 

« 

RESEARCH tackles complex mysteries that do not yield to man's 
reasoning and his accidental discoveries. Progress today comes largely 
because trained minds search for, and And, pertinent facts that other- 
wise elude us. In that process, barriers fall and Tshat has been impossi- 
ble comes to pass. 

RESEARCH has no relation to magic. It is painstaking, costly, a!td 
slew. It requires scientists, money, and time. Unlike magic, it pro- 
duces results — but they cannot readily be guessed, wiUed, nor 
scheduled. For who can predict {fevelopinents and their timing when 
exploring the unknown? 

RESEARCH is neither all-powerful nor infa.Uible, nor do its dis- 
coveries always pay off, A majority of indup/ory's new products fail in 
the marketplace — but those that succeed keep the firm in business. 

RESEARCH may utilize complex equipment and methods, but is 
successful because of an attitude: seek evidence impartially, weigh It 
without bias and follow where it leads, welcoming what can be useftiUy 
regarded as truth — but just as readily modifying* views when further 
information broadens knowledge. 

RESEARCH constitutes organized search for a t-etter future. Its 
dividends grow with the scale and skill of research, and with alertness 
in putting findings to the test of practice. 

RESEARCH holds no copyright on its basic philosophy, for we have , 
worked up from the stone age by heeding good evidence. But man’s 
progress is hindered by set ideas, often permitting years or generations 
to pass before useful knowle(fee is put to work, 

I 

TO HURRY today’s obstacles piit of tho way, it is necessary to pro- 
ceed in the spirit of research: forget rock-bound opinion, seek facts, 
and act on the best available information. 



Anon. 




